Difference between revisions of "Team:UNILA LatAm/Model"

Line 1: Line 1:
<!-- # TODO: #6 Fix table caption font--><!-- # TODO: #7 Fix citations links font size--><html lang="en"><head><meta charset="utf-8"/><meta content="width=device-width,initial-scale=1" name="viewport"/><title>Model | iGEM UNILA_LatAm</title><script src="https://2020.igem.org/common/MathJax-2.5-latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script><link href="https://2021.igem.org/Template:UNILA_LatAm/css/contentCSS?action=raw&amp;ctype=text/css" rel="stylesheet"/></head><body><!-- # TODO: #6 Fix table caption font--><!-- # TODO: #7 Fix citations links font size--><nav class="navbar navbar-expand-xl fixed-top"><div class="container d-flex justify-content-between"><a class="navbar-brand d-lg-inline-block" href="https://2021.igem.org/Team:UNILA_LatAm"><img ;="" src="https://static.igem.org/mediawiki/2021/9/98/T--UNILA_LatAm--Logo.png" style="width:auto; height:100px ;position: relative !important; margin-top:15px; right: 300px"/></a><button aria-controls="navbarNav" aria-expanded="false" aria-label="Toggle navigation" class="navbar-toggler" data-target="#navbarNav" data-toggle="collapse" type="button"><span class="navbar-toggler-icon"></span></button><div class="collapse navbar-collapse" id="navbarNav"><ul class="navbar-nav ml-auto"><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarProjectDropdown" role="button">Project</a><div aria-labelledby="navbarProjectDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Description">Description</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Design_Overview">Design Overview</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Background">Background</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Engineering">Engineering</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Contribution">Contribution</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarDryLabDropdown" role="button">DryLab</a><div aria-labelledby="navbarDryLabDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Design">Design</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Model">Model</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarWetLabDropdown" role="button">WetLab</a><div aria-labelledby="navbarWetLabDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Experiments">Experiments</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Results">Results</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Notebook">Notebook</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Protocols">Protocols</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Parts">Parts</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Safety">Safety</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarHuman PracticesDropdown" role="button">Human Practices</a><div aria-labelledby="navbarHuman PracticesDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Human_Practices">Introduction</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Sustainability">Sustainability</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Implementation">Implementation</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Fighting_Underreporting">Fighting Underreporting</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Integrated_Human_Practices">Integrated Human Practices</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Education">Education</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Inclusivity">Inclusivity</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Communication">Communication</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Funding">Funding</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarTeamDropdown" role="button">Team</a><div aria-labelledby="navbarTeamDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Team">Team Members</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Attributions">Attributions</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Collaborations">Collaborations</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Partnership">Partnership</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Sponsors">Sponsors</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarAwardsDropdown" role="button">Awards</a><div aria-labelledby="navbarAwardsDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Medal_Criteria">Medal Criteria</a></div></li></ul></div></div></nav><header class="d-flex justify-content-center align-items-center"><div class="container"><h1>Model</h1><p class="lead pl-1"></p><hr class="my-4"/></div></header><main><div class="container"><div class="row"><div class="sidebar col-lg-3"><div class="nav" id="contents"><h5>Contents</h5><ul></ul></div></div><div class="content col-lg-9"><article><h1>Summary</h1><p>Modeling is a fundamental part of the BioPank project since evaluating the paratransgenesis approach in the field or in the laboratory would require controlling and measuring different conditions. As detailed in this section, We built a kinetic model with parameter optimization, where an Ordinary DIfferential Equations (ODEs) framework coupled with sensitivity analysis evaluates the performance of our chassis under variable conditions in the midgut of the vector and of the engineered genetic circuit to eliminate leishmania. Also, we built the Carpincho Toehold Generator, specialized in the design of Toeholds for miRNAs detection and an essential tool to design our detection module throughout the project.</p><h1>Kinetic Model</h1><p><strong>Motivation</strong></p><p>The simulation exploits a preliminary screenshot of the circuit's behaviour to guide future experiments in the lab. In general, the persistence of the chassis and the efficiency of eliminating the parasite within the midgut are essential factors in paratransgenesis. For the success of our approach, we needed to understand how different conditions affect these events. Therefore, this kinetic model aimed to visualize leishmania death and chassis growth behavior over time. To optimize the system, we identified the parameters that control AMP production, chassis growth and parasite death in order to maximize i) the time needed to produce sufficient AMP to eliminate the parasite and ii) the chassis persistence within the vector.</p><p><strong>Model Structure</strong></p><p>This mechanistic model contains Detection and Elimination modules influenced by global transcriptional regulation based on chassis growth in the vector's midgut. The mass action kinetics describe the kinetic model applied to chassis growth, Toehold transcription, AMP translation, parasite elimination and degradation of molecules, resulting in seven entities (substrate <strong>[S]</strong>, chassis <strong>[Bs]</strong>, Toehold mRNA <strong>[mRNAtoehold]</strong>, activated Toehold mRNA <strong>[mRNAon]</strong>, proAMP <strong>[AMPoff]</strong> and AMP <strong>[AMPon]</strong> concentrations). The equations, involving 18 parameters (described in Complete Model Description), describe the 15 reactions of the entire process. In the following representation, we visualize the relationships between parameters and variables</p><div class="image"><img alt="Representation of reactions and biological mechanisms in our system." src="https://static.igem.org/mediawiki/2021/2/21/T--UNILA_Latam--modelingg.png" style="width: 100%"/><p>Figure 1: Representation of reactions and biological mechanisms in our system.</p></div><p>Based on this representation, we divided the system into four parts:</p><ul><li><strong>Growth Model</strong>, which describes <strong>Bacillus subtilis [Bs]</strong> concentration as a function of <strong>substrate availability</strong> (Monod kinetic equation) and concentration decay as a function of <strong>re-sporulation probability, decay rate</strong> due to varied conditions; and cytotoxic feedback of <strong>antimicrobial peptides [AMP]</strong>:</li></ul><p>$$\frac{d[Bs]}{dt} = V_{Bs,growth}-V_{Bs,death}$$</p><ul><li><strong>Substrate Flux</strong>, which indicates the <strong>substrate input</strong> (vector digestion) as a function of cosine wave, <strong>chassis consumption</strong> and <strong>substrate removal [S]</strong> over time in the midgut of the vector:</li></ul><p>$$\frac{d[S]}{dt} = V_{Bs,intake}-V_{S,rem}$$</p><ul><li><strong>Antimicrobial Peptide Expression Model (color)</strong>, which describes the <strong>constitutive transcription</strong> of Toehold mRNA [mRNAtoehold] as a function of chassis growth rate; the <strong>Toehold binding to miRNA trigger</strong> [mRNAon], considering the thermodynamic values obtained in the Carpincho tool (see below), enabling the <strong>proAMP translation</strong> [AMPoff]; and <strong>AMP acitvation</strong> [AMPon], through its <strong>diffusion</strong> to the extracellular medium and <strong>enzymatic digestion</strong> by trypsin at a constant rate. Also, we performed a rough approximation by multiplying the single cell AMP production per chassis concentration (cell/L) to measure the leishmanicidal activity. The AMPs and RNAs undergo first order <strong>degradation</strong> rates:</li></ul><p>$$\frac{d[mRNA_{toehold}]}{dt} = V_{tx,yoehold}-(V_{mRNA,on}+V_{mRNA,deg})$$</p><p>$$\frac{d[mRNA_{on}]}{dt} = V_{mRNA,on}-V_{mRNAon,deg}$$</p><p>$$\frac{d[AMP_{off}]}{dt} = V_{tl,AMP}-(V_{act,AMP}+V_{AMP,deg})$$</p><p>$$\frac{d[AMP_{on}]}{dt} = V_{act,AMP}-V_{AMP,deg}$$</p><ul><li><strong>Leishmania Death Model</strong>, which describes the influence of the concentration of activated antimicrobial peptides [AMPon] on parasite mortality as a function of Hill's equation:</li></ul><p>$$\frac{d[Leish]}{dt} = V_{Leish,growth}-V_{Leish,kill}$$</p><ul><li><p><strong>Major assumptions</strong>, before starting the simulation and analysis, we highlight the major assumptions considered in this model:</p><p>Substrate input has oscillatory behavior with the same frequency and amplitude;</p><p>The presence of the miRNA trigger is constant;</p><p>We only evaluate the chassis entry moment into the vector;</p></li></ul><p>For more assumptions, check below our Complete Model Description.<br/><h1>Complete Model Description</h1><p>Our complete ODEs system's description. assumptions and parameters can be checked in the next file. Also, Simulations and sensitivity analysis were performed using Colab Notebook for Python. The simulation graphs were plotted using the "plotly" package and the sensitive analysis graphs were plotted in RStudio. Codes can be downloaded <a href="https://2021.igem.org/File:T--UNILA_LatAM--ModelCodeUNILA.zip">here.</a></p> </p><div><iframe height="500px" src="https://static.igem.org/mediawiki/2021/2/22/T--UNILA_LatAM--asodp.pdf" width="100%"></iframe></div><br/><h1>Simulation Evaluation</h1><p>To assess the feasibility of our project, we solved the single system of ordinary differential equations using the "odeint" function from the SciPy package for Python. Each reaction has been built upon parameter and initial condition regarding appropriate kinetic rate laws at steady state (Complete Description). The simulation presented the results of the dynamics of our chassis concentrations, the substrate flux, the expression circuit, AMPs concentrations and parasite death.</p><p>The prediction is consistent with the dynamics of our system (Fig. 2,3 and 4) and the results were positive for eliminating parasite. In Figure 2, as expected using the Monod equation, which considers the concentration of a nutrient-limited (in this case, glucose), the chassis colony had a growth directly related to the substrate input rate. On the other hand, it is observed that the transcription and translation had a disturbance of close to 200 minutes. This oscillation happens because we describe transcription as a function of global regulation, where <strong>growth rate is directly related to the constitutive promoter activity</strong> and dilution rates [9,15]. The drop of substrate availability decreases the growth rate and concentration of viable chassis, which induces a negative perturbation in the expression levels in Figures 3 and 4.</p><iframe height="800px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/Growth_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 2</strong>. Dynamic of the concentration of our chassis (A) and substrate (B).</p><iframe height="800px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/RNA_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 3</strong>. Dynamic of single-cell mRNA concentrations within 500 minutes (A) and 30 minutes of simulation (B) between activated (green line) and deactivated (blue line) Toehold mRNAs. Dashed lines: Time to Half maximal Toehold activation from transcripts.</p><iframe height="400px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/AMPLeish_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 4</strong>. A) Dynamic of colony proAMP production (purple line) and activation(blue line). B) Dynamic of <i>Leishmania</i> viable cells inside the midgut. Dashed lines: Time to reach half maximal inhibitory.</p><p>Even though this model integrated a strategy with the thermodynamic values obtained in the toehold design, its model neglects the <strong>uptake of miRNAs</strong>. In the model, the RNA uptake occurs at constant rates, which may have influenced the rapid activation shown in Figure 3, approximately 4 minutes for the activated toehold to reach half of its maximum concentration. Overall, these model simulations demonstrate the <strong>feasibility of our project</strong> to eliminate the parasite within the vector. The time needed to reach half-maximal inhibitory behavior was around 115 minutes (Fig. 4B) and keeping these positive results, we decided to go deeper and analyze the influence of each parameter on our system.</p><h1>Analysis and Parameter Estimation</h1><p>We could not measure all parameters experimentally, especially due to difficulties in lab access this year and the number of parameters required to evaluate a paratransgenesis system. As shown in Parameters Table (from Complete Description), we used parameter values found in literature, which may not match our scenario since biological systems and experiments vary considerably between studies [17]. Furthermore, biological systems are subject to stochasticity and noise, which can make a parameter estimation difficult for nonlinear models [18]. We applied a Global Sensitivity Analysis (GSA) that seeks to determine the relative effect of the main reactions/parameters on the system-wide output dynamics through simultaneous perturbations on all inputs during several samplings.</p><p><em>Global Sensitivity Analysis</em></p><p>The lack of computational capacity and time available motivated our team to perform this analysis only in the last time-step of the simulation (last step = 500min). We set up the GSA with 520,000 parameter sets (from 10,000 samples for each variable and 25 parameters, sets = N(2D+2)), randomly sampled within 5% of their reference values (Complete Description). As a result, we obtained the values of the first-, second and total-order Sobol Indices to analyze the significance of each parameter for AMP production, chassis growth and parasite death.</p><p>In Figure 5, the First order sensitivity indices has six values greater than 0.2 for each component analyzed. This observation demonstrates that some parameters alone have the potential to affect the system significantly. Here, we consider values close to or above 0.4, such as <strong>n (AMPs Hill Coefficient)</strong> and <strong>v (B. subtilis maximum growth rate)</strong>.</p><iframe height="350px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/First_Sen_Analy.html" style="border:none;" width="100%"></iframe><p> <br> Figure 5.  First Order sensitivity indices for the last simulation step (500min). <br> On another hand, second order sensitivity indices show interactions between the parameters with a low level of effect on the model output, as shown in Figure 6. The interaction between <strong>v</strong> and <strong>lamb</strong> (single-cell half-life for B. subtilis persistence decay rate, see Complete Description) will be negligible due to the low index value.</p><iframe height="600px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/Second_Sen_Analy.html" style="border:none;" width="100%"></iframe><p><strong>Figure 6</strong>. Second Order sensitivity indices for the last simulation step (500min).</p><p>In Figure 7, Total-order sensitivity indices contain the same aspect as the first-order indices. However, the lamb index probably increases due to its interaction analyzed in Figure 6.</p><p><strong>Total-Order Sobol Indices</strong></p><iframe height="350px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/Total_Sen_Analy.html" style="border:none;" width="100%"></iframe><p><strong>Figure 7</strong>. Total Order sensitivity indices for the last simulation step (500min).</p><p>Overall, the model and analysis achieve important directions despite the system not showing robustness in specific parameters. First, we note that the amount of AMP is significantly affected by <strong>gene expression circuit parameters</strong> that describe the degradation rates of the molecule (i.e., DEGrna), transcription, and enzymatic trypsin digestion (i.e., dig_rat). It is noteworthy that these reactions have been simplified and most of the variables related to their mechanism have been neglected (see Complete Description).</p><p>Second, the concentrations of activated AMP, chassis and parasite are directly influenced through kinetic characteristics related to chassis growth and AMP cooperativity. These values are consistent with their interaction throughout the system, as the cooperativity of AMP (<strong>n</strong>) can affect the growth of our chassis (remember that AMP can be <strong>toxic for both parasite and chassis</strong>) and, consequently, the production of AMP. Also, the maximum growth (<strong>v</strong>) rate can interfere with the transcription rate and directly affect the concentration of <i>Leishmania</i> (remember that we describe our transcription rate with <strong>global regulation</strong>).</p><p>To assess their impact on the time response to reach 50% inhibition of <i>Leishmania</i> viable cells, we simulated a wide range of AMP cooperativity, n (1 to 4), and a wide range of maximum growth rates for the chassis, v (0 to 0.064 min-1). In figure 8, we see that the v parameter strongly affects the response time for half elimination. Furthermore, it is important to consider that we only assume the analysis starting from the chassis input in the vector, that is, considering the proAMPs system, we could have previously high AMP levels.</p><iframe height="550px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/3D_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 8</strong>. Half-Elimination Response time as function of two significantly parameters: n (AMP's Hill coefficient) and v (maximum growth rate of Bacillus subtilis)</p><p>Finally, despite showing a non-robust behavior in the variation of these parameters, efforts to optimize the system and the quick response can be focused on the engineering of AMPs and on the growth capacity of our chassis. We can evaluate different AMPs with different cooperativity mechanisms and also optimize substrate uptake by the chassis. Furthermore, we note that the chassis decay rate within the vector (lamb) must be carefully evaluated in future experiments (see Protection Module). Its interaction with chassis growth properties significantly affects the output system dynamics.</p><h1>Conclusions</h1><p>Our model and analysis show promising system efficiency results and helped obtain screenshots to guide future efforts. The robustness of the system must be evaluated to tune the most significant parameters. The way we built the model helped in these future steps, as we focused on measurable parameters for wet lab analysis conditions that we have in our laboratory. <strong>Hill's coefficient (n)</strong> and <strong>maximum growth rate (v)</strong> appeared as the most relevant parameters to be tuned, leading to experiments trying to assess Hill coefficient for our AMPs candidates during this season (see Experiments). Finally, more robust analyses can increase system understanding. For instance, some negative values appear in the GSA and we evaluate the output of a time-step. The Sobol method considers unusual negative values, and the GSA must be evaluated along all time-steps due to the simulation non-linearity. More extensive sampled analyses can solve these factors.</p><h1>Carpincho Toehold Designer</h1><p>The design of toehold switches requires an in silico knowledge of the thermodynamic characteristics that can influence their application. Our team built the Carpincho Toehold Designer, a slow but efficient way to design our Toeholds for detecting miR-283 (from L. longipalpis) obtained from midgut by Bacillus subtilis. The Carpincho Tool strictly follows the Type II model described by Green et al. (2020) and bases its operation on NUPACK Design and Analysis algorithms [20].</p><p>Carpincho is a Toeholds generator that requires low computational knowledge and requires few inputs to generate the libraries. We calculate the Minimum Free Energy (MFE) variation between the binding and unbound state through the energy difference between the structures formed by Trigger and Toehold binding with the MFE of conformation of Trigger and Toehold alone. Then, we can select the best candidates according to the relationship:</p><p>$$\Delta G_{DeltaMFE}&lt;\Delta G_{Switch}+\Delta G_{mRNA Trigger}$$</p><div id="con4"><img id="bac" src="https://static.igem.org/mediawiki/2021/d/d8/T--UNILA_LatAM--toehold_git.png"/></div><p>In addition, other factors can be considered, such as ensemble_defects and MFE RBS_Linker, parameters that can optimize Toehold activation and decrease the leaky expression. The code and the generated results (conformation figures and thermodynamic data) can be consulted in our <a href="https://github.com/igemsoftware2021/CarpinchoToeholdDesigner">repository</a>. Despite having some limitations, Carpincho can be optimized to expand its design potential to other miRNAs in different organisms.</p><h1>References</h1><ol><li><p><a href="https://www.nature.com/articles/s41598-020-62213-6">Ugalde-Salas, P. et al. Insights from Microbial Transition State Theory on Monod’s Affinity Constant. Nature Scientific Reports, 2020.</a></p></li><li><p><a href="https://journals.plos.org/plosntds/article?id=10.1371/journal.pntd.0003923">Heerman, M. et al. Bacterial Infection and Immune Responses in Lutzomyia longipalpis Sand Fly Larvae Midgut. PLOS Neglected Tropical Diseases, 2015.</a></p></li><li><p><a href="https://journals.asm.org/doi/10.1128/AEM.00322-19">Gauvry, E. et al. Differentiation of Vegetative Cells into Spores: a Kinetic Model Applied to Bacillus subtilis. Applied and Environmental Microbiology, 2019</a></p></li><li><p><a href="https://www.science.org/lookup/doi/10.1126/science.aan5478">Wang, S. et al. Driving mosquito refractoriness to Plasmodium falciparum with engineered symbiotic bacteria. Science, 2017.</a></p></li><li><p><a href="https://bionumbers.hms.harvard.edu/bionumber.aspx?s=n&amp;v=1&amp;id=115203">BioNumbers ID 115203</a></p></li><li><p><a href="https://www.hindawi.com/journals/cmmm/2015/581829/">Wang, X. Modeling of the Bacillus subtilis Bacterial Biofilm Growing on an Agar Substrate. Hindawi: Computational and Mathematical Methods in Medicine, 2015.</a></p></li><li><p><a href="https://sfamjournals.onlinelibrary.wiley.com/doi/10.1111/1462-2920.12676">Overkamp, W. et al. Physiological and cell morphology adaptation of Bacillus subtilis at near-zero specific growth rates: a transcriptome analysis. Environmental Microbiology, 2014.</a></p></li><li><p><a href="https://journals.asm.org/doi/10.1128/AEM.00322-19">Gauvry, E. et al. Differentiation of Vegetative Cells into Spores: a Kinetic Model Applied to Bacillus subtilis. Applied and Environmental Microbiology, 2019</a></p></li><li><p><a href="https://www.embopress.org/doi/full/10.1038/msb.2013.14">Gerosa, L. 2013. Dissecting specific and global transcriptional regulation of bacterial gene expression. Molecular Systems Biology, 2013.</a></p></li><li><p><a href="https://www.mdpi.com/1420-3049/18/6/7058/htm">Brand, G. D. et al. The Skin Secretion of the Amphibian Phyllomedusa nordestina: A source of Antimicrobial and Antiprotozoal Peptides. Molecules, 2013.</a></p></li><li><p><a href="https://www.sciencedirect.com/science/article/pii/S0006291X06014690?casa_token=Nd1t2crmYgIAAAAA:QpLee1RlLvwTurOFOrWjPXG71e2QmkqV_T19jXB8X2fWcQ63rcHDOak7XXv-d-ZYWNQ_14Tsyoa86A">Brand, G. D. et al. Novel dermaseptins from Phyllomedusa hypochondialis (Amphibia). Biochemical and Biophysical Research Communications, 2006.</a></p></li><li><p><a href="https://www.sciencedirect.com/science/article/pii/S019697811100026X?casa_token=NoXQzSPWDAAAAAAA:r5Fxhn-osyrxip2O7E-Qo7FvrIOuk76uUEzwXJp2n0WvjF4Lsr2eWfQZ6aosT-9UKTBFKV7J2QxBsg">Perez-Cordero, J.J. et al. (2011) Leishmanicidal activity of synthetic antimicrobial peptides in an infection model with human dendritic cells. Peptides, 32(4), p. 683-690</a></p></li><li><p><a href="https://www.nature.com/articles/s41564-018-0125-7">Serafim, T. D. et al. Sequential blood meals promote Leishmania replication and reverse metacyclogenesis augmenting vector infectivity. Nature Microbiology, 2018</a></p></li><li><p><a href="https://jbioleng.biomedcentral.com/track/pdf/10.1186/1754-1611-7-29.pdf">Radeck, J. et al. The Bacillus Biobrick Box: generation and evaluation of essential genetic building blocks for standardized work with Bacillus subtilis. Journal of Biological Engineering. 2013.</a></p></li><li><p><a href="https://jbioleng.biomedcentral.com/articles/10.1186/1754-1611-7-22">Hintsche, M.;Klumpp,S. (2013) Dilution and theorical description of growth-rate dependent gene expression. Journal of Biological Engineering, 7(22).</a></p></li><li><p>Senoussi, A. Quantitative characterization of translational riboregulator using an in vitro transcription-translation system. ACS Synthetic Biology, 2018.</p></li><li><p><a href="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0079244">Kent, E. et al.(2013) What Can We Learn from Global Sensitivity Analysis of Biochemical Systems?. PLoS ONE 8(11):e79244.</a></p></li><li><p><a href="https://www.frontiersin.org/articles/10.3389/fbioe.2019.00234/full">Quang, M. N. et al. (2019) Global Sensitivity Analysis of Metabolic Models for Phosphorus Accumulating Organisms in Enhanced Biological Phosphorus Removal. Frontiers in Bioengineering and Biotechnology. 237(7).</a></p></li></ol></article></div></div></div></main><footer><div class="container" id="contfoot"><div id="div1"><br/><p>BioPank is a project developed by</p><p>the Syn Fronteras team</p><br/><br/><br/><p id="text1">Contact</p><p>synfronteras@gmail.com</p></div><div id="div2"><p id="fow">Follow us!</p><img height="30px" src="https://static.igem.org/mediawiki/2021/c/c9/T--UNILA_LatAM--fb.png" weight="30px"/><a href="https://www.facebook.com/synfronteras/">/synfronteras<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/2/2c/T--UNILA_LatAM--ig.png" weight="30px"/><a href="https://www.instagram.com/igem_synfronteras/">@igem_synfronteras<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/1/19/T--UNILA_LatAM--in.png" weight="30px"/><a href="https://br.linkedin.com/in/synfronteras-igem-team-77a7891ba">SynFronteras iGEM Team<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/2/27/T--UNILA_LatAM--tw.png" weight="30px"/><a href="https://twitter.com/synfronteras">@synfronteras<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/0/02/T--UNILA_LatAM--yt.png" weight="30px"/><a href="https://www.youtube.com/channel/UCHGAVNbPReEbzdEHeansZQg">SynFronteras-UNILA<br/></a></div></div></footer><script src="https://2021.igem.org/Template:UNILA_LatAm/content-bundleJS?action=raw&amp;ctype=text/javascript"></script></body></html>
+
<!-- # TODO: #6 Fix table caption font--><!-- # TODO: #7 Fix citations links font size--><html lang="en"><head><meta charset="utf-8"/><meta content="width=device-width,initial-scale=1" name="viewport"/><title>Model | iGEM UNILA_LatAm</title><script src="https://2020.igem.org/common/MathJax-2.5-latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script><link href="https://2021.igem.org/Template:UNILA_LatAm/css/contentCSS?action=raw&amp;ctype=text/css" rel="stylesheet"/></head><body><!-- # TODO: #6 Fix table caption font--><!-- # TODO: #7 Fix citations links font size--><nav class="navbar navbar-expand-xl fixed-top"><div class="container d-flex justify-content-between"><a class="navbar-brand d-lg-inline-block" href="https://2021.igem.org/Team:UNILA_LatAm"><img ;="" src="https://static.igem.org/mediawiki/2021/9/98/T--UNILA_LatAm--Logo.png" style="width:auto; height:100px ;position: relative !important; margin-top:15px; right: 300px"/></a><button aria-controls="navbarNav" aria-expanded="false" aria-label="Toggle navigation" class="navbar-toggler" data-target="#navbarNav" data-toggle="collapse" type="button"><span class="navbar-toggler-icon"></span></button><div class="collapse navbar-collapse" id="navbarNav"><ul class="navbar-nav ml-auto"><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarProjectDropdown" role="button">Project</a><div aria-labelledby="navbarProjectDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Description">Description</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Design_Overview">Design Overview</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Background">Background</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Engineering">Engineering</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Contribution">Contribution</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarDryLabDropdown" role="button">DryLab</a><div aria-labelledby="navbarDryLabDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Design">Design</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Model">Model</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarWetLabDropdown" role="button">WetLab</a><div aria-labelledby="navbarWetLabDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Experiments">Experiments</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Results">Results</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Notebook">Notebook</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Protocols">Protocols</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Parts">Parts</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Safety">Safety</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarHuman PracticesDropdown" role="button">Human Practices</a><div aria-labelledby="navbarHuman PracticesDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Human_Practices">Introduction</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Sustainability">Sustainability</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Implementation">Implementation</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Fighting_Underreporting">Fighting Underreporting</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Integrated_Human_Practices">Integrated Human Practices</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Education">Education</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Inclusivity">Inclusivity</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Communication">Communication</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Funding">Funding</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarTeamDropdown" role="button">Team</a><div aria-labelledby="navbarTeamDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Team">Team Members</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Attributions">Attributions</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Collaborations">Collaborations</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Partnership">Partnership</a><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Sponsors">Sponsors</a></div></li><li class="nav-item dropdown"><a aria-expanded="false" aria-haspopup="true" class="nav-link dropdown-toggle" data-toggle="dropdown" href="#" id="navbarAwardsDropdown" role="button">Awards</a><div aria-labelledby="navbarAwardsDropdown" class="dropdown-menu"><a class="dropdown-item" href="https://2021.igem.org/Team:UNILA_LatAm/Medal_Criteria">Medal Criteria</a></div></li></ul></div></div></nav><header class="d-flex justify-content-center align-items-center"><div class="container"><h1>Model</h1><p class="lead pl-1"></p><hr class="my-4"/></div></header><main><div class="container"><div class="row"><div class="sidebar col-lg-3"><div class="nav" id="contents"><h5>Contents</h5><ul></ul></div></div><div class="content col-lg-9"><article><h1>Summary</h1><p>Modeling is a fundamental part of the BioPank project since evaluating the paratransgenesis approach in the field or in the laboratory would require controlling and measuring different conditions. As detailed in this section, We built a kinetic model with parameter optimization, where an Ordinary DIfferential Equations (ODEs) framework coupled with sensitivity analysis evaluates the performance of our chassis under variable conditions in the midgut of the vector and of the engineered genetic circuit to eliminate leishmania. Also, we built the Carpincho Toehold Generator, specialized in the design of Toeholds for miRNAs detection and an essential tool to design our detection module throughout the project.</p><h1>Kinetic Model</h1><p><strong>Motivation</strong></p><p>The simulation exploits a preliminary screenshot of the circuit's behaviour to guide future experiments in the lab. In general, the persistence of the chassis and the efficiency of eliminating the parasite within the midgut are essential factors in paratransgenesis. For the success of our approach, we needed to understand how different conditions affect these events. Therefore, this kinetic model aimed to visualize leishmania death and chassis growth behavior over time. To optimize the system, we identified the parameters that control AMP production, chassis growth and parasite death in order to maximize i) the time needed to produce sufficient AMP to eliminate the parasite and ii) the chassis persistence within the vector.</p><p><strong>Model Structure</strong></p><p>This mechanistic model contains Detection and Elimination modules influenced by global transcriptional regulation based on chassis growth in the vector's midgut. The mass action kinetics describe the kinetic model applied to chassis growth, Toehold transcription, AMP translation, parasite elimination and degradation of molecules, resulting in seven entities (substrate <strong>[S]</strong>, chassis <strong>[Bs]</strong>, Toehold mRNA <strong>[mRNAtoehold]</strong>, activated Toehold mRNA <strong>[mRNAon]</strong>, proAMP <strong>[AMPoff]</strong> and AMP <strong>[AMPon]</strong> concentrations). The equations, involving 18 parameters (described in Table 1), describe the 15 reactions of the entire process. In the following representation, we visualize the relationships between parameters and variables</p><div class="image"><img alt="Representation of reactions and biological mechanisms in our system." src="https://static.igem.org/mediawiki/2021/2/21/T--UNILA_Latam--modelingg.png" style="width: 100%"/><p>Figure 1: Representation of reactions and biological mechanisms in our system.</p></div><p>Based on this representation, we divided the system into four parts:</p><ul><li><strong>Growth Model</strong>, which describes <strong>Bacillus subtilis [Bs]</strong> concentration as a function of <strong>substrate availability</strong> (Monod kinetic equation) and concentration decay as a function of <strong>re-sporulation probability, decay rate</strong> due to varied conditions; and cytotoxic feedback of <strong>antimicrobial peptides [AMP]</strong>:</li></ul><p>$$\frac{d[Bs]}{dt} = V_{Bs,growth}-V_{Bs,death}$$</p><ul><li><strong>Substrate Flux</strong>, which indicates the <strong>substrate input</strong> (vector digestion) as a function of cosine wave, <strong>chassis consumption</strong> and <strong>substrate removal [S]</strong> over time in the midgut of the vector:</li></ul><p>$$\frac{d[S]}{dt} = V_{Bs,intake}-V_{S,rem}$$</p><ul><li><strong>Antimicrobial Peptide Expression Model (color)</strong>, which describes the <strong>constitutive transcription</strong> of Toehold mRNA [mRNAtoehold] as a function of chassis growth rate; the <strong>Toehold binding to miRNA trigger</strong> [mRNAon], considering the thermodynamic values obtained in the Carpincho tool (see below), enabling the <strong>proAMP translation</strong> [AMPoff]; and <strong>AMP acitvation</strong> [AMPon], through its <strong>diffusion</strong> to the extracellular medium and <strong>enzymatic digestion</strong> by trypsin at a constant rate. Also, we performed a rough approximation by multiplying the single cell AMP production per chassis concentration (cell/L) to measure the leishmanicidal activity. The AMPs and RNAs undergo first order <strong>degradation</strong> rates:</li></ul><p>$$\frac{d[mRNA_{toehold}]}{dt} = V_{tx,yoehold}-(V_{mRNA,on}+V_{mRNA,deg})$$</p><p>$$\frac{d[mRNA_{on}]}{dt} = V_{mRNA,on}-V_{mRNAon,deg}$$</p><p>$$\frac{d[AMP_{off}]}{dt} = V_{tl,AMP}-(V_{act,AMP}+V_{AMP,deg})$$</p><p>$$\frac{d[AMP_{on}]}{dt} = V_{act,AMP}-V_{AMP,deg}$$</p><ul><li><strong>Leishmania Death Model</strong>, which describes the influence of the concentration of activated antimicrobial peptides [AMPon] on leishmania mortality as a function of Hill's equation:</li></ul><p>$$\frac{d[Leish]}{dt} = V_{Leish,growth}-V_{Leish,kill}$$</p><ul><li><p><strong>Major assumptions</strong>, before starting the simulation and analysis, we highlight the major assumptions considered in this model:</p><p>Substrate input has oscillatory behavior with the same frequency and amplitude;</p><p>The presence of the miRNA trigger is constant;</p><p>We only evaluate the chassis entry moment into the vector;</p></li></ul><p>For more assumptions, check below our complete model description.</p><div><iframe height="500px" src="https://static.igem.org/mediawiki/2021/b/b8/T--UNILA_LatAM--KineticM.pdf" width="100%"></iframe></div><br/><br/><h1>Complete Model Description</h1><p>Our complete ODEs system's description. assumptions and parameters can be checked in the next file. Also, Simulations and sensitivity analysis were performed using Colab Notebook for Python. The simulation graphs were plotted using the "plotly" package and the sensitive analysis graphs were plotted in RStudio. Codes can be downloaded <a href="https://2021.igem.org/File:T--UNILA_LatAM--ModelCodeUNILA.zip">here.</a></p><h1>Simulation Evaluation</h1><p>To assess the feasibility of our project, we solved the single system of ordinary differential equations using the "odeint" function from the SciPy package for Python. Each reaction has been built upon parameter and initial condition regarding appropriate kinetic rate laws at steady state (Table 1). The simulation presented the results of the dynamics of our chassis concentrations, the substrate flux, the expression circuit, AMPs concentrations and parasite death.</p><p>The prediction is consistent with the dynamics of our system (Fig. 2,3 and 4) and the results were positive for eliminating leishmania. In Figure 2, as expected using the Monod equation, which considers the concentration of a nutrient-limited (in this case, glucose), the chassis colony had a growth directly related to the substrate input rate. On the other hand, it is observed that the transcription and translation had a disturbance of close to 200 minutes. This oscillation happens because we describe transcription as a function of global regulation, where <strong>growth rate is directly related to the constitutive promoter activity</strong> and dilution rates [9,15]. The drop of substrate availability decreases the growth rate and concentration of viable chassis, which induces a negative perturbation in the expression levels in Figures 3 and 4.</p><iframe height="800px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/Growth_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 2</strong>. Dynamic of the concentration of our chassis (A) and substrate (B).</p><iframe height="800px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/RNA_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 3</strong>. Dynamic of single-cell mRNA concentrations within 500 minutes (A) and 30 minutes of simulation (B) between activated (green line) and deactivated (blue line) Toehold mRNAs. Dashed lines: Time to Half maximal Toehold activation from transcripts.</p><iframe height="800px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/AMPLeish_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 4</strong>. A) Dynamic of colony proAMP production (purple line) and activation(blue line). B) Dynamic of Leishmania viable cells inside the midgut. Dashed lines: Time to reach half maximal inhibitory.</p><p>Even though this model integrated a strategy with the thermodynamic values obtained in the toehold design, its model neglects the <strong>uptake of miRNAs</strong>. In the model, the RNA uptake occurs at constant rates, which may have influenced the rapid activation shown in Figure 3, approximately 4 minutes for the activated toehold to reach half of its maximum concentration. Overall, these model simulations demonstrate the <strong>feasibility of our project</strong> to eliminate the parasite within the vector. The time needed to reach half-maximal inhibitory behavior was around 115 minutes (Fig. 4B) and keeping these positive results, we decided to go deeper and analyze the influence of each parameter on our system.</p><h1>Analysis and Parameter Estimation</h1><p>We could not measure all parameters experimentally, especially due to difficulties in lab access this year and the number of parameters required to evaluate a paratransgenesis system. As shown in Table 1, we used parameter values found in literature, which may not match our scenario since biological systems and experiments vary considerably between studies [17]. Furthermore, biological systems are subject to stochasticity and noise, which can make a parameter estimation difficult for nonlinear models [18]. We applied a Global Sensitivity Analysis (GSA) that seeks to determine the relative effect of the main reactions/parameters on the system-wide output dynamics through simultaneous perturbations on all inputs during several samplings.</p><p><strong>Global Sensitivity Analysis</strong></p><p>The lack of computational capacity and time available motivated our team to perform this analysis only in the last time-step of the simulation (last step = 500min). We set up the GSA with 520,000 parameter sets (from 10,000 samples for each variable and 25 parameters, sets = N(2D+2)), randomly sampled within 5% of their reference values (Table 1). As a result, we obtained the values of the first-, second and total-order Sobol Indices to analyze the significance of each parameter for AMP production, chassis growth and parasite death.</p><p>In Figure 5, the First order sensitivity indices has six values greater than 0.2 for each component analyzed. This observation demonstrates that some parameters alone have the potential to affect the system significantly. Here, we consider values close to or above 0.4, such as <strong>n (AMPs Hill Coefficient)</strong> and <strong>v (B. subtilis maximum growth rate)</strong>.</p><iframe height="350px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/First_Sen_Analy.html" style="border:none;" width="100%"></iframe><p>On another hand, second order sensitivity indices show interactions between the parameters with a low level of effect on the model output, as shown in Figure 6. The interaction between <strong>v</strong> and <strong>lamb</strong> (single-cell half-life for B. subtilis persistence decay rate, Table 1) will be negligible due to the low index value.</p><iframe height="600px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/Second_Sen_Analy.html" style="border:none;" width="100%"></iframe><p><strong>Figure 6</strong>. Second Order sensitivity indices for the last simulation step (500min).</p><p>In Figure 7, Total-order sensitivity indices contain the same aspect as the first-order indices. However, the lamb index probably increases due to its interaction analyzed in Figure 6.</p><p><strong>Total-Order Sobol Indices</strong></p><iframe height="350px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/Total_Sen_Analy.html" style="border:none;" width="100%"></iframe><p><strong>Figure 7</strong>. Total Order sensitivity indices for the last simulation step (500min).</p><p>Overall, the model and analysis achieve important directions despite the system not showing robustness in specific parameters. First, we note that the amount of AMP is significantly affected by <strong>gene expression circuit parameters</strong> that describe the degradation rates of the molecule (i.e., DEGrna), transcription, and enzymatic trypsin digestion (i.e., dig_rat). It is noteworthy that these reactions have been simplified and most of the variables related to their mechanism have been neglected (see Complete Description).</p><p>Second, the concentrations of activated AMP, chassis and parasite are directly influenced through kinetic characteristics related to chassis growth and AMP cooperativity. These values are consistent with their interaction throughout the system, as the cooperativity of AMP (<strong>n</strong>) can affect the growth of our chassis (remember that AMP can be <strong>toxic for both parasite and chassis</strong>) and, consequently, the production of AMP. Also, the maximum growth (<strong>v</strong>) rate can interfere with the transcription rate and directly affect the concentration of Leishmania (remember that we describe our transcription rate with <strong>global regulation</strong>).</p><p>To assess their impact on the time response to reach 50% inhibition of Leishmania viable cells, we simulated a wide range of AMP cooperativity, n (1 to 4), and a wide range of maximum growth rates for the chassis, v (0 to 0.064 min-1). In figure 8, we see that the v parameter strongly affects the response time for half elimination. Furthermore, it is important to consider that we only assume the analysis starting from the chassis input in the vector, that is, considering the proAMPs system, we could have previously high AMP levels.</p><iframe height="550px" id="igraph" scrolling="no" seamless="seamless" src="https://chagas98.github.io/3D_sim_UNILA_LatAm.html" style="border:none;" width="100%"></iframe><p><strong>Figure 8</strong>. Half-Elimination Response time as function of two significantly parameters: n (AMP's Hill coefficient) and v (maximum growth rate of Bacillus subtilis)</p><p>Finally, despite showing a non-robust behavior in the variation of these parameters, efforts to optimize the system and the quick response can be focused on the engineering of AMPs and on the growth capacity of our chassis. We can evaluate different AMPs with different cooperativity mechanisms and also optimize substrate uptake by the chassis. Furthermore, we note that the chassis decay rate within the vector (lamb) must be carefully evaluated in future experiments (see Protection Module). Its interaction with chassis growth properties significantly affects the output system dynamics.</p><h1>Conclusions</h1><p>Our model and analysis show promising system efficiency results and helped obtain screenshots to guide future efforts. The robustness of the system must be evaluated to tune the most significant parameters. The way we built the model helped in these future steps, as we focused on measurable parameters for wet lab analysis conditions that we have in our laboratory. <strong>Hill's coefficient (n)</strong> and <strong>maximum growth rate (v)</strong> appeared as the most relevant parameters to be tuned, leading to experiments trying to assess Hill coefficient for our AMPs candidates during this season (see Experiments). Finally, more robust analyses can increase system understanding. For instance, some negative values appear in the GSA and we evaluate the output of a time-step. The Sobol method considers unusual negative values, and the GSA must be evaluated along all time-steps due to the simulation non-linearity. More extensive sampled analyses can solve these factors.</p><h1>Carpincho Toehold Designer</h1><p>The design of toehold switches requires an in silico knowledge of the thermodynamic characteristics that can influence their application. Our team built the Carpincho Toehold Designer, a slow but efficient way to design our Toeholds for detecting miR-283 (from L. longipalpis) obtained from midgut by Bacillus subtilis. The Carpincho Tool strictly follows the Type II model described by Green et al. (2020) and bases its operation on NUPACK Design and Analysis algorithms [20].</p><p>Carpincho is a Toeholds generator that requires low computational knowledge and requires few inputs to generate the libraries. We calculate the Minimum Free Energy (MFE) variation between the binding and unbound state through the energy difference between the structures formed by Trigger and Toehold binding with the MFE of conformation of Trigger and Toehold alone. Then, we can select the best candidates according to the relationship:</p><p>$$\Delta G_{DeltaMFE}&lt;\Delta G_{Switch}+\Delta G_{mRNA Trigger}$$</p><div id="con4"><img id="bac" src="https://static.igem.org/mediawiki/2021/9/94/T--UNILA_LatAM--TT.png"/></div><p>In addition, other factors can be considered, such as ensemble_defects and MFE RBS_Linker, parameters that can optimize Toehold activation and decrease the leaky expression. The code and the generated results (conformation figures and thermodynamic data) can be consulted in our <a href="https://github.com/igemsoftware2021/CarpinchoToeholdDesigner">repository</a>. Despite having some limitations, Carpincho can be optimized to expand its design potential to other miRNAs in different organisms.</p><h1>References</h1><p>[1]. Ugalde-Salas, P. et al. Insights from Microbial Transition State Theory on Monod's Affinity Constant. <a href="https://www.nature.com/articles/s41598-020-62213-6">Nature Scientific Reports, 2020.</a></p><p>[2]. Heerman, M. et al. Bacterial Infection and Immune Responses in Lutzomyia longipalpis Sand Fly Larvae Midgut. <a href="https://journals.plos.org/plosntds/article?id=10.1371/journal.pntd.0003923">PLOS Neglected Tropical Diseases, 2015.</a></p><p>[3]. Gauvry, E. et al. Differentiation of Vegetative Cells into Spores: a Kinetic Model Applied to Bacillus subtilis. <a href="https://journals.asm.org/doi/10.1128/AEM.00322-19">Applied and Environmental Microbiology, 2019</a></p><p>[4]. Wang, S. et al. Driving mosquito refractoriness to Plasmodium falciparum with engineered symbiotic bacteria. <a href="https://www.science.org/lookup/doi/10.1126/science.aan5478">Science, 2017.</a></p><p>[5]. <a href="https://bionumbers.hms.harvard.edu/bionumber.aspx?s=n&amp;v=1&amp;id=115203">BioNumbers ID 115203</a></p><p>[6]. Wang, X. Modeling of the Bacillus subtilis Bacterial Biofilm Growing on an Agar Substrate. <a href="https://www.hindawi.com/journals/cmmm/2015/581829/">Hindawi: Computational and Mathematical Methods in Medicine, 2015.</a></p><p>[7]. Overkamp, W. et al. Physiological and cell morphology adaptation of Bacillus subtilis at near-zero specific growth rates: a transcriptome analysis. <a href="https://sfamjournals.onlinelibrary.wiley.com/doi/10.1111/1462-2920.12676">Environmental Microbiology, 2014.</a></p><p>[8]. Gauvry, E. et al. Differentiation of Vegetative Cells into Spores: a Kinetic Model Applied to Bacillus subtilis. <a href="https://journals.asm.org/doi/10.1128/AEM.00322-19">Applied and Environmental Microbiology, 2019</a></p><p>[9]. Gerosa, L. 2013. Dissecting specific and global transcriptional regulation of bacterial gene expression. <a href="https://www.embopress.org/doi/full/10.1038/msb.2013.14">Molecular Systems Biology, 2013.</a></p><p>[10]. Brand, G. D. et al. The Skin Secretion of the Amphibian Phyllomedusa nordestina: A source of Antimicrobial and Antiprotozoal Peptides. <a href="https://www.mdpi.com/1420-3049/18/6/7058/htm">Molecules, 2013.</a></p><p>[11]. Brand, G. D. et al. Novel dermaseptins from Phyllomedusa hypochondialis (Amphibia). <a href="https://www.sciencedirect.com/science/article/pii/S0006291X06014690?casa_token=Nd1t2crmYgIAAAAA:QpLee1RlLvwTurOFOrWjPXG71e2QmkqV_T19jXB8X2fWcQ63rcHDOak7XXv-d-ZYWNQ_14Tsyoa86A">Biochemical and Biophysical Research Communications, 2006.</a></p><p>[12]. Pérez-Cordero, J.J. et al. (2011) Leishmanicidal activity of synthetic antimicrobial peptides in an infection model with human dendritic cells. <a href="https://www.sciencedirect.com/science/article/pii/S019697811100026X?casa_token=NoXQzSPWDAAAAAAA:r5Fxhn-osyrxip2O7E-Qo7FvrIOuk76uUEzwXJp2n0WvjF4Lsr2eWfQZ6aosT-9UKTBFKV7J2QxBsg">Peptides, 32(4), p. 683-690</a></p><p>[13]. Serafim, T. D. et al. Sequential blood meals promote Leishmania replication and reverse metacyclogenesis augmenting vector infectivity.<a href="https://www.nature.com/articles/s41564-018-0125-7"> Nature Microbiology, 2018</a></p><p>[14]. Radeck, J. et al. The Bacillus Biobrick Box: generation and evaluation of essential genetic building blocks for standardized work with Bacillus subtilis.<a href="https://jbioleng.biomedcentral.com/track/pdf/10.1186/1754-1611-7-29.pdf"> Journal of Biological Engineering. 2013.</a></p><p>[15]. Hintsche, M.;Klumpp,S. (2013) Dilution and theorical description of growth-rate dependent gene expression. <a href="https://jbioleng.biomedcentral.com/articles/10.1186/1754-1611-7-22">Journal of Biological Engineering, 7(22).</a></p><p>[16]. Senoussi, A. Quantitative characterization of translational riboregulator using an in vitro transcription-translation system. ACS Synthetic Biology, 2018.</p><p>[17]. Kent, E. et al.(2013) What Can We Learn from Global Sensitivity Analysis of Biochemical Systems?. <a href="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0079244">PLoS ONE 8(11):e79244.</a></p><p>[18]. Quang, M. N. et al. (2019) Global Sensitivity Analysis of Metabolic Models for Phosphorus Accumulating Organisms in Enhanced Biological Phosphorus Removal. <a href="https://www.frontiersin.org/articles/10.3389/fbioe.2019.00234/full">Frontiers in Bioengineering and Biotechnology. 237(7).</a></p><p>[19]. Green, A.A. et al. (2020). Complex cellular logic computation using ribocomputing devices. Nature, 548, p. 117-121.</p><p>[20]. Green, A.A. et al. (2020). Complex cellular logic computation using ribocomputing devices. Nature, 548, p. 117-121.</p></article></div></div></div></main><footer><div class="container" id="contfoot"><div id="div1"><p id="descri">A Project by</p><br/><img height="100px" src="https://static.igem.org/mediawiki/2021/d/dc/T--UNILA_LatAM--LogoV3.png" weight="100px"/><br/><br/><p id="text1">Contact</p><p>synfronteras@gmail.com</p></div><div id="div2"><p id="spon">Sponsor</p><br/><a href="https://www.itaipu.gov.br/"><img height="150px" id="spons" src="https://static.igem.org/mediawiki/2021/8/89/T--UNILA_LatAM--LogoIPH.png" weight="150px"/></a></div><div id="div3"><p id="fow">Follow us!</p><br/><img height="30px" id="aa" src="https://static.igem.org/mediawiki/2021/c/c9/T--UNILA_LatAM--fb.png" weight="30px"/><a href="https://www.facebook.com/synfronteras/">/synfronteras<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/2/2c/T--UNILA_LatAM--ig.png" weight="30px"/><a href="https://www.instagram.com/igem_synfronteras/">@igem_synfronteras<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/1/19/T--UNILA_LatAM--in.png" weight="30px"/><a href="https://br.linkedin.com/in/synfronteras-igem-team-77a7891ba">SynFronteras iGEM Team<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/2/27/T--UNILA_LatAM--tw.png" weight="30px"/><a href="https://twitter.com/synfronteras">@synfronteras<br/></a><img height="30px" src="https://static.igem.org/mediawiki/2021/0/02/T--UNILA_LatAM--yt.png" weight="30px"/><a href="https://www.youtube.com/channel/UCHGAVNbPReEbzdEHeansZQg">SynFronteras-UNILA<br/></a></div></div></footer><script src="https://2021.igem.org/Template:UNILA_LatAm/content-bundleJS?action=raw&amp;ctype=text/javascript"></script></body></html>

Revision as of 22:41, 13 December 2021

Model | iGEM UNILA_LatAm

Model


Summary

Modeling is a fundamental part of the BioPank project since evaluating the paratransgenesis approach in the field or in the laboratory would require controlling and measuring different conditions. As detailed in this section, We built a kinetic model with parameter optimization, where an Ordinary DIfferential Equations (ODEs) framework coupled with sensitivity analysis evaluates the performance of our chassis under variable conditions in the midgut of the vector and of the engineered genetic circuit to eliminate leishmania. Also, we built the Carpincho Toehold Generator, specialized in the design of Toeholds for miRNAs detection and an essential tool to design our detection module throughout the project.

Kinetic Model

Motivation

The simulation exploits a preliminary screenshot of the circuit's behaviour to guide future experiments in the lab. In general, the persistence of the chassis and the efficiency of eliminating the parasite within the midgut are essential factors in paratransgenesis. For the success of our approach, we needed to understand how different conditions affect these events. Therefore, this kinetic model aimed to visualize leishmania death and chassis growth behavior over time. To optimize the system, we identified the parameters that control AMP production, chassis growth and parasite death in order to maximize i) the time needed to produce sufficient AMP to eliminate the parasite and ii) the chassis persistence within the vector.

Model Structure

This mechanistic model contains Detection and Elimination modules influenced by global transcriptional regulation based on chassis growth in the vector's midgut. The mass action kinetics describe the kinetic model applied to chassis growth, Toehold transcription, AMP translation, parasite elimination and degradation of molecules, resulting in seven entities (substrate [S], chassis [Bs], Toehold mRNA [mRNAtoehold], activated Toehold mRNA [mRNAon], proAMP [AMPoff] and AMP [AMPon] concentrations). The equations, involving 18 parameters (described in Table 1), describe the 15 reactions of the entire process. In the following representation, we visualize the relationships between parameters and variables

Representation of reactions and biological mechanisms in our system.

Figure 1: Representation of reactions and biological mechanisms in our system.

Based on this representation, we divided the system into four parts:

  • Growth Model, which describes Bacillus subtilis [Bs] concentration as a function of substrate availability (Monod kinetic equation) and concentration decay as a function of re-sporulation probability, decay rate due to varied conditions; and cytotoxic feedback of antimicrobial peptides [AMP]:

$$\frac{d[Bs]}{dt} = V_{Bs,growth}-V_{Bs,death}$$

  • Substrate Flux, which indicates the substrate input (vector digestion) as a function of cosine wave, chassis consumption and substrate removal [S] over time in the midgut of the vector:

$$\frac{d[S]}{dt} = V_{Bs,intake}-V_{S,rem}$$

  • Antimicrobial Peptide Expression Model (color), which describes the constitutive transcription of Toehold mRNA [mRNAtoehold] as a function of chassis growth rate; the Toehold binding to miRNA trigger [mRNAon], considering the thermodynamic values obtained in the Carpincho tool (see below), enabling the proAMP translation [AMPoff]; and AMP acitvation [AMPon], through its diffusion to the extracellular medium and enzymatic digestion by trypsin at a constant rate. Also, we performed a rough approximation by multiplying the single cell AMP production per chassis concentration (cell/L) to measure the leishmanicidal activity. The AMPs and RNAs undergo first order degradation rates:

$$\frac{d[mRNA_{toehold}]}{dt} = V_{tx,yoehold}-(V_{mRNA,on}+V_{mRNA,deg})$$

$$\frac{d[mRNA_{on}]}{dt} = V_{mRNA,on}-V_{mRNAon,deg}$$

$$\frac{d[AMP_{off}]}{dt} = V_{tl,AMP}-(V_{act,AMP}+V_{AMP,deg})$$

$$\frac{d[AMP_{on}]}{dt} = V_{act,AMP}-V_{AMP,deg}$$

  • Leishmania Death Model, which describes the influence of the concentration of activated antimicrobial peptides [AMPon] on leishmania mortality as a function of Hill's equation:

$$\frac{d[Leish]}{dt} = V_{Leish,growth}-V_{Leish,kill}$$

  • Major assumptions, before starting the simulation and analysis, we highlight the major assumptions considered in this model:

    Substrate input has oscillatory behavior with the same frequency and amplitude;

    The presence of the miRNA trigger is constant;

    We only evaluate the chassis entry moment into the vector;

For more assumptions, check below our complete model description.



Complete Model Description

Our complete ODEs system's description. assumptions and parameters can be checked in the next file. Also, Simulations and sensitivity analysis were performed using Colab Notebook for Python. The simulation graphs were plotted using the "plotly" package and the sensitive analysis graphs were plotted in RStudio. Codes can be downloaded here.

Simulation Evaluation

To assess the feasibility of our project, we solved the single system of ordinary differential equations using the "odeint" function from the SciPy package for Python. Each reaction has been built upon parameter and initial condition regarding appropriate kinetic rate laws at steady state (Table 1). The simulation presented the results of the dynamics of our chassis concentrations, the substrate flux, the expression circuit, AMPs concentrations and parasite death.

The prediction is consistent with the dynamics of our system (Fig. 2,3 and 4) and the results were positive for eliminating leishmania. In Figure 2, as expected using the Monod equation, which considers the concentration of a nutrient-limited (in this case, glucose), the chassis colony had a growth directly related to the substrate input rate. On the other hand, it is observed that the transcription and translation had a disturbance of close to 200 minutes. This oscillation happens because we describe transcription as a function of global regulation, where growth rate is directly related to the constitutive promoter activity and dilution rates [9,15]. The drop of substrate availability decreases the growth rate and concentration of viable chassis, which induces a negative perturbation in the expression levels in Figures 3 and 4.

Figure 2. Dynamic of the concentration of our chassis (A) and substrate (B).

Figure 3. Dynamic of single-cell mRNA concentrations within 500 minutes (A) and 30 minutes of simulation (B) between activated (green line) and deactivated (blue line) Toehold mRNAs. Dashed lines: Time to Half maximal Toehold activation from transcripts.

Figure 4. A) Dynamic of colony proAMP production (purple line) and activation(blue line). B) Dynamic of Leishmania viable cells inside the midgut. Dashed lines: Time to reach half maximal inhibitory.

Even though this model integrated a strategy with the thermodynamic values obtained in the toehold design, its model neglects the uptake of miRNAs. In the model, the RNA uptake occurs at constant rates, which may have influenced the rapid activation shown in Figure 3, approximately 4 minutes for the activated toehold to reach half of its maximum concentration. Overall, these model simulations demonstrate the feasibility of our project to eliminate the parasite within the vector. The time needed to reach half-maximal inhibitory behavior was around 115 minutes (Fig. 4B) and keeping these positive results, we decided to go deeper and analyze the influence of each parameter on our system.

Analysis and Parameter Estimation

We could not measure all parameters experimentally, especially due to difficulties in lab access this year and the number of parameters required to evaluate a paratransgenesis system. As shown in Table 1, we used parameter values found in literature, which may not match our scenario since biological systems and experiments vary considerably between studies [17]. Furthermore, biological systems are subject to stochasticity and noise, which can make a parameter estimation difficult for nonlinear models [18]. We applied a Global Sensitivity Analysis (GSA) that seeks to determine the relative effect of the main reactions/parameters on the system-wide output dynamics through simultaneous perturbations on all inputs during several samplings.

Global Sensitivity Analysis

The lack of computational capacity and time available motivated our team to perform this analysis only in the last time-step of the simulation (last step = 500min). We set up the GSA with 520,000 parameter sets (from 10,000 samples for each variable and 25 parameters, sets = N(2D+2)), randomly sampled within 5% of their reference values (Table 1). As a result, we obtained the values of the first-, second and total-order Sobol Indices to analyze the significance of each parameter for AMP production, chassis growth and parasite death.

In Figure 5, the First order sensitivity indices has six values greater than 0.2 for each component analyzed. This observation demonstrates that some parameters alone have the potential to affect the system significantly. Here, we consider values close to or above 0.4, such as n (AMPs Hill Coefficient) and v (B. subtilis maximum growth rate).

On another hand, second order sensitivity indices show interactions between the parameters with a low level of effect on the model output, as shown in Figure 6. The interaction between v and lamb (single-cell half-life for B. subtilis persistence decay rate, Table 1) will be negligible due to the low index value.

Figure 6. Second Order sensitivity indices for the last simulation step (500min).

In Figure 7, Total-order sensitivity indices contain the same aspect as the first-order indices. However, the lamb index probably increases due to its interaction analyzed in Figure 6.

Total-Order Sobol Indices

Figure 7. Total Order sensitivity indices for the last simulation step (500min).

Overall, the model and analysis achieve important directions despite the system not showing robustness in specific parameters. First, we note that the amount of AMP is significantly affected by gene expression circuit parameters that describe the degradation rates of the molecule (i.e., DEGrna), transcription, and enzymatic trypsin digestion (i.e., dig_rat). It is noteworthy that these reactions have been simplified and most of the variables related to their mechanism have been neglected (see Complete Description).

Second, the concentrations of activated AMP, chassis and parasite are directly influenced through kinetic characteristics related to chassis growth and AMP cooperativity. These values are consistent with their interaction throughout the system, as the cooperativity of AMP (n) can affect the growth of our chassis (remember that AMP can be toxic for both parasite and chassis) and, consequently, the production of AMP. Also, the maximum growth (v) rate can interfere with the transcription rate and directly affect the concentration of Leishmania (remember that we describe our transcription rate with global regulation).

To assess their impact on the time response to reach 50% inhibition of Leishmania viable cells, we simulated a wide range of AMP cooperativity, n (1 to 4), and a wide range of maximum growth rates for the chassis, v (0 to 0.064 min-1). In figure 8, we see that the v parameter strongly affects the response time for half elimination. Furthermore, it is important to consider that we only assume the analysis starting from the chassis input in the vector, that is, considering the proAMPs system, we could have previously high AMP levels.

Figure 8. Half-Elimination Response time as function of two significantly parameters: n (AMP's Hill coefficient) and v (maximum growth rate of Bacillus subtilis)

Finally, despite showing a non-robust behavior in the variation of these parameters, efforts to optimize the system and the quick response can be focused on the engineering of AMPs and on the growth capacity of our chassis. We can evaluate different AMPs with different cooperativity mechanisms and also optimize substrate uptake by the chassis. Furthermore, we note that the chassis decay rate within the vector (lamb) must be carefully evaluated in future experiments (see Protection Module). Its interaction with chassis growth properties significantly affects the output system dynamics.

Conclusions

Our model and analysis show promising system efficiency results and helped obtain screenshots to guide future efforts. The robustness of the system must be evaluated to tune the most significant parameters. The way we built the model helped in these future steps, as we focused on measurable parameters for wet lab analysis conditions that we have in our laboratory. Hill's coefficient (n) and maximum growth rate (v) appeared as the most relevant parameters to be tuned, leading to experiments trying to assess Hill coefficient for our AMPs candidates during this season (see Experiments). Finally, more robust analyses can increase system understanding. For instance, some negative values appear in the GSA and we evaluate the output of a time-step. The Sobol method considers unusual negative values, and the GSA must be evaluated along all time-steps due to the simulation non-linearity. More extensive sampled analyses can solve these factors.

Carpincho Toehold Designer

The design of toehold switches requires an in silico knowledge of the thermodynamic characteristics that can influence their application. Our team built the Carpincho Toehold Designer, a slow but efficient way to design our Toeholds for detecting miR-283 (from L. longipalpis) obtained from midgut by Bacillus subtilis. The Carpincho Tool strictly follows the Type II model described by Green et al. (2020) and bases its operation on NUPACK Design and Analysis algorithms [20].

Carpincho is a Toeholds generator that requires low computational knowledge and requires few inputs to generate the libraries. We calculate the Minimum Free Energy (MFE) variation between the binding and unbound state through the energy difference between the structures formed by Trigger and Toehold binding with the MFE of conformation of Trigger and Toehold alone. Then, we can select the best candidates according to the relationship:

$$\Delta G_{DeltaMFE}<\Delta G_{Switch}+\Delta G_{mRNA Trigger}$$

In addition, other factors can be considered, such as ensemble_defects and MFE RBS_Linker, parameters that can optimize Toehold activation and decrease the leaky expression. The code and the generated results (conformation figures and thermodynamic data) can be consulted in our repository. Despite having some limitations, Carpincho can be optimized to expand its design potential to other miRNAs in different organisms.

References

[1]. Ugalde-Salas, P. et al. Insights from Microbial Transition State Theory on Monod's Affinity Constant. Nature Scientific Reports, 2020.

[2]. Heerman, M. et al. Bacterial Infection and Immune Responses in Lutzomyia longipalpis Sand Fly Larvae Midgut. PLOS Neglected Tropical Diseases, 2015.

[3]. Gauvry, E. et al. Differentiation of Vegetative Cells into Spores: a Kinetic Model Applied to Bacillus subtilis. Applied and Environmental Microbiology, 2019

[4]. Wang, S. et al. Driving mosquito refractoriness to Plasmodium falciparum with engineered symbiotic bacteria. Science, 2017.

[5]. BioNumbers ID 115203

[6]. Wang, X. Modeling of the Bacillus subtilis Bacterial Biofilm Growing on an Agar Substrate. Hindawi: Computational and Mathematical Methods in Medicine, 2015.

[7]. Overkamp, W. et al. Physiological and cell morphology adaptation of Bacillus subtilis at near-zero specific growth rates: a transcriptome analysis. Environmental Microbiology, 2014.

[8]. Gauvry, E. et al. Differentiation of Vegetative Cells into Spores: a Kinetic Model Applied to Bacillus subtilis. Applied and Environmental Microbiology, 2019

[9]. Gerosa, L. 2013. Dissecting specific and global transcriptional regulation of bacterial gene expression. Molecular Systems Biology, 2013.

[10]. Brand, G. D. et al. The Skin Secretion of the Amphibian Phyllomedusa nordestina: A source of Antimicrobial and Antiprotozoal Peptides. Molecules, 2013.

[11]. Brand, G. D. et al. Novel dermaseptins from Phyllomedusa hypochondialis (Amphibia). Biochemical and Biophysical Research Communications, 2006.

[12]. Pérez-Cordero, J.J. et al. (2011) Leishmanicidal activity of synthetic antimicrobial peptides in an infection model with human dendritic cells. Peptides, 32(4), p. 683-690

[13]. Serafim, T. D. et al. Sequential blood meals promote Leishmania replication and reverse metacyclogenesis augmenting vector infectivity. Nature Microbiology, 2018

[14]. Radeck, J. et al. The Bacillus Biobrick Box: generation and evaluation of essential genetic building blocks for standardized work with Bacillus subtilis. Journal of Biological Engineering. 2013.

[15]. Hintsche, M.;Klumpp,S. (2013) Dilution and theorical description of growth-rate dependent gene expression. Journal of Biological Engineering, 7(22).

[16]. Senoussi, A. Quantitative characterization of translational riboregulator using an in vitro transcription-translation system. ACS Synthetic Biology, 2018.

[17]. Kent, E. et al.(2013) What Can We Learn from Global Sensitivity Analysis of Biochemical Systems?. PLoS ONE 8(11):e79244.

[18]. Quang, M. N. et al. (2019) Global Sensitivity Analysis of Metabolic Models for Phosphorus Accumulating Organisms in Enhanced Biological Phosphorus Removal. Frontiers in Bioengineering and Biotechnology. 237(7).

[19]. Green, A.A. et al. (2020). Complex cellular logic computation using ribocomputing devices. Nature, 548, p. 117-121.

[20]. Green, A.A. et al. (2020). Complex cellular logic computation using ribocomputing devices. Nature, 548, p. 117-121.