ToxSci Advance Access originally published online on May 22, 2007
Toxicological Sciences 2007 99(1):289-302; doi:10.1093/toxsci/kfm131
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Acute Hepatotoxicity: A Predictive Model Based on Focused Illumina Microarrays


* Molecular Toxicology
Pathology and Histopathology
Institute of Toxicology, Merck KGaA, Darmstadt, 64293 Germany
1 To whom correspondence should be addressed at Institute of Toxicology – Molecular Toxicology, Merck KGaA, Frankfurter Str. 250, 64293 Darmstadt, Germany. Fax: +49-6151-912927. E-mail: philip.hewitt{at}merck.de.
Received February 28, 2007; accepted May 14, 2007
| ABSTRACT |
|---|
|
|
|---|
Drug-induced hepatotoxicity is a major issue for drug development, and toxicogenomics has the potential to predict toxicity during early toxicity screening. A bead-based Illumina oligonucleotide microarray containing 550 liver specific genes has been developed. We have established a predictive screening system for acute hepatotoxicity by analyzing differential gene expression profiles of well-known hepatotoxic and nonhepatotoxic compounds. Low and high doses of tetracycline, carbon tetrachloride (CCL4), 1-naphthylisothiocyanate (ANIT), erythromycin estolate, acetaminophen (AAP), or chloroform as hepatotoxicants, clofibrate, theophylline, naloxone, estradiol, quinidine, or dexamethasone as nonhepatotoxic compounds, were administered as a single dose to male Sprague–Dawley rats. After 6, 24, and 72 h, livers were taken for histopathological evaluation and for analysis of gene expression alterations. All hepatotoxic compounds tested generated individual gene expression profiles. Based on leave-one-out cross-validation analysis, gene expression profiling allowed the accurate discrimination of all model compounds, 24 h after high dose treatment. Even during the regeneration phase, 72 h after treatment, CCL4, ANIT, and AAP were predicted to be hepatotoxic, and only these three compounds showed histopathological changes at this time. Furthermore, we identified 64 potential marker genes responsible for class prediction, which reflected typical hepatotoxicity responses. These genes and pathways, commonly deregulated by hepatotoxicants, may be indicative of the early characterization of hepatotoxicity and possibly predictive of later hepatotoxicity onset. Two unknown test compounds were used for prevalidating the screening test system, with both being correctly predicted. We conclude that focused gene microarrays are sufficient to classify compounds with respect to toxicity prediction.
Key Words: gene expression changes; toxicogenomics; early prediction; screening model; Illumina microarray; rat in vivo model.
| INTRODUCTION |
|---|
|
|
|---|
Toxicology testing is central for the safety of drug development candidates. Indeed, adverse drug effects are still a major reason for drug withdrawal from the market. Hence, new powerful techniques are needed to improve the detection of potentially toxic compounds from the drug development process earlier. Toxicogenomics, which makes use of DNA microarray technologies and measures the expression of thousands of genes simultaneously, has the potential to revolutionize toxicology. It has been used as a tool to elucidate mechanisms and to predict toxicity (Duggan et al., 1999
Predictive toxicology relies mainly on class prediction, whose methods are based on the assumption that gene expression profiles of known toxins from representative toxicological classes (model compounds) can predict the toxicological effects of unknown compounds (UNCs) based on similarities between gene expression profiles (Maggioli et al., 2006
; Schena et al., 1995
). Thus, gene expression data can provide an early indication of toxicity because toxin-mediated changes in gene expression are often detectable before clinical chemistry, histopathology, or clinical observations (Ulrich and Friend, 2002
).
Thomas et al. (2001)
published one of the first classification algorithms used for the accurate prediction of 24 model compounds based on leave-one-out cross-validation of a large microarray database. Hamadeh et al. (2002)
used discrimination algorithms to classify blind samples based on a training set using high-density gene expression profiles. Steiner et al. (2004)
used support vector machine (SVM) to obtain an optimal discrimination between hepatotoxic and nonhepatotoxic compounds (based on 26 toxic compounds) with their whole genome Affymetrix microarray profiles. These studies varied in experimental design (e.g., time of dosage and number of compounds investigated), but all indicated the potential of toxicogenomics in predictive toxicological risk assessment.
Due to the demand for cheaper, higher-throughput screening systems for toxicity testing, as well as the relatively high costs of high density arrays, the question arises whether a microarray focused on toxicologically relevant genes could also be predictive. Therefore, we established an oligonucleotide microarray with 550 genes, chosen based on their known involvement in hepatotoxicity (published information and internal Merck KGaA bioinformatic data from previous studies), to aid in the classification and risk assessment of acute hepatotoxicity. Our customized focused microarray was designed using the oligonucleotide Sentrix BeadChips (Illumina, Inc., San Diego, CA) based on the BeadArray technology (Gunderson et al., 2004
; Steemers and Gunderson, 2005
).
Due to the fact that the liver is the primary site for drug metabolism and hepatotoxicity is one of the most frequently reported human adverse drug reactions, we concentrated on the prediction of hepatotoxicity. Thus, 12 model compounds, including six well-known hepatotoxicants, were chosen based on an extensive literature study, namely carbon tetrachloride (CCL4), chloroform (CHCL3), both inducers of necrosis and steatosis (Brattin et al., 1985
; Minami et al., 2005
; Wang et al., 1997
; Weber et al., 2003
; Yamamoto et al., 2006
), 1-naphthylisothiocyanate (ANIT) a well-known cholestasis inducer (Krell et al., 1982
; Mehendale et al., 1994
; Orsler et al., 1999
), the antibiotics tetracycline (TET), and erythromycin estolate (EE) which cause steatosis and cholestasis, respectively (Amacher and Martin 1997
; de Longueville et al., 2003
; Fromenty and Pessayre, 1995
; Garcia Monzon et al., 1985
; Venkateswaran et al., 1998
; Yamamoto et al., 2006
), and the drug acetaminophen (AAP), a well-known hepatotoxicant causing liver necrosis (James et al., 2003
; Minami et al., 2005
; Prescott, 1980
; Yamamoto et al., 2006
). As nonacute rodent hepatotoxicants the drugs clofibrate (CF) (peroxisome proliferator–activated receptor [PPAR-
] agonist) (Corton et al., 2000
; Richert et al., 2003
; Yadetie et al., 2003
), theophylline (THEO) (diuretic), naloxone (NLX) (analgesic), estradiol (E2) (estrogen), quinidine (QUIN) (antiarrhythmic), and dexamethasone (DEX) (corticosteroid) were chosen.
The primary goal of the current paper was to determine whether gene expression based on a relative small set of genes could discriminate between animals acutely treated with various model compounds known to cause hepatotoxicity or with nonhepatotoxic compounds at different time points and dose levels. Such a discriminatory model maybe used for the early characterization of potential hepatotoxicants and maybe for the prediction of chronic hepatotoxic endpoints. Above all, in respect to the 3Rs concept, this would mean significant reduction in animal usage due to the performance of shorter-term studies for the early classification of novel untested compounds.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Animal Treatment
Tissue samples, used for transcription profiling, were derived from studies using albino Sprague–Dawley rats (Crl:CD) treated by single intraperitoneal injection with test compounds and were obtained from an external tissue bank (PHASE-1 Santa Fe, NM). All studies were performed according to Good Laboratory Praxis (GLP). Briefly, male Sprague–Dawley rats approximately 10–11 weeks old were maintained on certified rodent chow (PMI Feeds Inc., Purina Mills, Richmond, IN) and tap water ad libitum in individual stainless steel cages at a 12-h light/12-h dark period. Treatment was conducted at two dose levels: (1) a maximum tolerated dose (MTD) level (high dose [hd]), which was chosen based on clear signs of toxicity with little or no lethality (published and unpublished information) and (2) around
of the MTD level (low dose [ld]). The following test compounds were chosen: TET 50 mg/kg (ld) or 150 mg/kg (hd), ANIT 15 mg/kg (ld) or 60 mg/kg (hd), THEO 25 mg/kg (ld) or 100 mg/kg (hd), NLX 45 mg/kg (ld) or 180 mg/kg (hd), QUIN 25 mg/kg (ld) or 100 mg/kg (hd), DEX 8 mg/kg (ld) or 30 mg/kg (hd), CHCL3 0.25 ml/kg (hd) (all prepared in saline), CCL4 0.25 ml/kg (ld) or 1 ml/kg (hd), CHCL3 0.1 ml/kg (ld) (both prepared in corn oil), EE 40 mg/kg (ld) or 160 mg/kg (hd), CF 75 mg/kg (ld), or 250 mg/kg (hd) (both prepared in 8%polyethylene glycol/8% ETOH), E2 0.1 mg/kg (ld) or 0.4 mg/kg (hd) (prepared in 5% ETOH), or AAP 250 mg/kg (ld) or 1000 mg/kg (hd) (prepared in water). Control groups were treated with vehicle only. Three rats were used for each treatment, control group or time point, and sacrificed at 6, 24, or 72 h. Livers were taken for histopathological evaluation (by PHASE 1 Molecular Toxicology, Inc.) and remaining liver tissues were snap frozen in liquid nitrogen, stored at – 80°C, and transferred to our laboratory for further analysis.
Histopathology
Histopathological examinations of the liver section from all animals of the 72-h groups, stained with hematoxylin and eosin, were conducted by PHASE 1, Inc. The observed liver alterations were scored and categorized (Table 2).
|
RNA Isolation and Analysis
Total RNA from liver samples (50–90 mg) was isolated using TRI REAGENT (Sigma-Aldrich Inc., St Louis, MO) according to the manufacture's instruction. In addition, after the ethanol precipitation step in the extraction procedure, a cleanup step using the QIAGEN RNeasy Mini kit columns (Qiagen GmbH, Hilden, Germany) was performed to obtain a better yield for later in vitro transcription labeling. The quality of total RNA was checked by gel analysis using the total RNA Nano chip assay on an Agilent 2100 Bioanalyzer (Agilent Technologies GmbH, Berlin, Germany). RNA concentrations were determined using the NanoDrop spectrophotometer (NanoDrop Technologies, Wilmington, DE).
Probe Labeling and Illumina Sentrix BeadChip array Hybridization
Biotin-labeled cRNA samples for hybridization on custom Illumina Sentrix BeadChip arrays (Illumina, Inc.) were prepared according to Illumina's recommended sample labeling procedure based on the modified Eberwine protocol (Eberwine et al., 1992
). In brief, 500 ng total RNA was used for complementary DNA (cDNA) synthesis, followed by an amplification/labeling step (in vitro transcription) to synthesize biotin-labeled cRNA according to the MessageAmp II aRNA Amplification kit (Ambion, Inc., Austin, TX), with the following modifications requested by Illumina: standard reactions were cut down to
size, separate annealing step of the T7 oligo(dT) primer was omitted (single step of the first-strand cDNA synthesis), and cleanup columns were replaced. QIAquick PCR Purification kit and QIAGEN RNeasy Mini kit (Qiagen), used according to the manufacture's recommendations, were used for cDNA purification (elution with water instead of the kits EB buffer) and for cRNA purification (eluted two times with 50 µl of water), respectively. Biotin-16-UTP was purchased from PerkinElmer Life and Analytical Sciences, Boston, MA. Due to a reduced amount of standard reactions, total RNA and purified cDNA were dried down and then dissolved in synthesis solutions. The column-purified cRNA was quality controlled using the messenger RNA (mRNA) Nano Chip Assay on an Agilent 2100 Bioanalyzer and spectrophotometrically quantified (NanoDrop).
Five hundred nanograms of amplified biotin-labeled cRNA was then prepared in a solution of 45% (vol/vol) Hyb E1 buffer (Illumina, Inc.) and 25% (vol/vol) deionized formamide (Ambion, Inc.) at a final concentration of 25 ng/µl. After preheating at 65°C for 5 min the cRNA samples were hybridized with the Sentrix BeadChips in a BeadChip Hyb Cartridge for 18 h at 55°C (Hybaid Maxi 14 hybridization oven, Thermo Electron Corporation, Waltham, MA). After hybridization, the Sentrix BeadChips were washed for 15 min on an orbital shaker in 250 ml of 0.3% (vol/vol) Wash E1BC buffer (Illumina, Inc.) solution and then blocked for 5 min in 4 ml of 1% (wt/vol) Blocker Casein in phosphate buffered saline, Hammarsten grade (Pierce Biotechnology, Inc., Rockford, IL). Array signals were developed by a 10-min incubation in 2 ml of 1 µg/ml Cy3-streptavidin (Amersham Biosciences, Buckinghamshire, UK) solution and 1% blocking solution. The BeadChips were washed a second time in diluted Wash E1BC buffer for 5 min, dried immediately after removal by centrifugation at 275x g for 4 min at 25°C, and scanned.
Focused Illumina BeadChip microarray Analysis
Data acquisition.
The focused Sentrix Illumina BeadChips, with each BeadChip comprising eight microarrays on a glass slide, were scanned at a wavelength of 532 nm and 5-µm resolution on the GenePix 4000B Microarray Scanner (Axon Instruments Inc., Union City, CA; Molecular Devices Corporation, Sunnyvale, CA). Images were captured with the GenePix Pro 5.0 software (Axon, Molecular Devices Corporation) according to the manufacture's instructions. Due to the random nature of the assembled microarrays all spots in the image were aligned with a de-code map (result of the manufacturers decoding process, delivered with each focused Illumina microarray) containing the positions of all 50,000 randomly assembled microbeads on the array and the identities of the probes found on those beads (Galinsky, 2003
; Gunderson et al., 2004
). The decoding process, which uses a molecular address, is part of the array manufacture procedure and provides a quality control for all elements of every array (Gunderson et al., 2004
). Subsequently, bead signal intensity extraction, using the imaging and data extraction software, AnEx (Illumina, Inc.), was performed prior to further analysis. The focused Illumina microarrays contain about 1500 unique probe sequences (Probe ID), or bead types (two 50 mer oligonucleotide probes/gene), corresponding to 550 annotated rat genes and several control genes (Gene ID). Each probe sequence is represented by approximately 30 beads on each array and each bead contains more than 105 copies of unique covalently attached oligonucleotide probes (Gunderson et al., 2004
; Steemers and Gunderson, 2005
). Using AnEx, the intensities of all beads (
30) were condensed to an average intensity value per probe ID and then further condensed to one signal intensity value per Gene ID. This is associated with a detection p value calculated from the background, characterized by the chance that the target sequence signal was distinguishable from the negative controls. Gene IDs with detection values > 0.99 were designated as reliable.
Array quality.
Focused Illumina microarray quality was determined by image viewing and incorporated control bead analysis (housekeeping, hybridization, signal generation, and background). Arrays with overall intensity outliers from the majority of arrays (caused by poor hybridization conditions or poor imaging) were excluded from further analysis. Fourteen housekeeping genes were used to check the intactness of the biological sample. Hybridization controls covering (1) three concentrations (low, medium, and high) of Cy3-labeled oligonucleotides present in the Hyb E1 buffer were used to yield a gradient hybridization response signal independent of both the cellular RNA quality and success of the sample preparation reactions (six probes), (2) Cy3-labeled probes, including a mismatch oligonucleotide with two single base changes (each), to control for nonspecific hybridization (four probes), and (3) Cy3-labeled oligonucleotide target with a high G–C content to check the stringency grade (one probe). Two probes with complementary biotin-tagged oligonucleotides present in the Hyb E1 buffer were used to control for signal generation. Negative controls consisting of 20 probes of random sequences selected to have no corresponding targets in the rat genome were used to define a background signal, representing the image system background as well as any signal resulting from nonspecific binding of dye or cross-hybridization.
Normalization.
Quality controlled focused Illumina microarrays were "chip-wise" normalized using the rank invariant algorithm (Kuhn et al., 2004
) and resulting data further analyzed using the Expressionist Analyst software (GeneData, Basel, Switzerland). Briefly, a second normalization of all microarrays over all gene signal intensities based on the arithmetic mean was performed. Comparative analysis between control and treated samples was done separately for each individual compound, including fold change (average signal intensity treated/average signal intensity control) and a significance value (p value), calculated using a two-tailed, unpaired t-test. A p value less than 0.05 was accepted as significant. In addition, the false discovery rate (FDR, Benjamini–Hochberg q value) was determined and included into Table 3 to improve the relevance of these significantly deregulated genes.
|
Modeling/classification.
For SVM classification, implemented in the cross-validation tool of Expressionist Analyst software, only normalized intensity values of the treated samples were considered. The samples were categorized as either hepatotoxic or nonhepatotoxic and further subcategorized into the time and dose. A linear kernel and a penalty of 10 were chosen as the parameters for the SVM algorithm. The leave-one-out cross-validation scheme with 12 repeats (representing the number of compounds) was used for a robust discrimination. Genes for final discrimination between hepatotoxicity and nonhepatotoxicity were identified by gene ranking analysis of variance (ANOVA). Molecular functions of the genes were individually annotated by using the classification schemes in Gene Ontology, KEGG database (keg.org), and MetaCore 3.1 software (GeneGO, Inc., St Joseph, MI).
Real-time PCR
All RNA samples from the hd 24-h animals and their corresponding time-matched vehicle controls were used to verify 13 genes (Table 1) with different biological functions, chosen from the pool of discriminative genes. Since classification models for discrimination analysis do not primarily select either significant and/or genes with pronounced fold changes from either hepatotoxicants or nonhepatotoxic compounds as discriminative gene, the acute phase gene Metallothionein 1a (Mt1a) was added as it showed distinct deregulation by many of the compounds (similar to a positive control). Two housekeeping genes, 18S ribosomal RNA (rRNA) and B2m, were run in parallel.
|
cDNA synthesis and analysis.
One microgram total RNA was reverse transcribed to cDNA using random hexamer primers with the first-strand cDNA synthesis kit for reverse transcription-PCR (RT-PCR) avian myeloblastosis virus reverse transcriptase (Roche, Mannheim, Germany) according to the manufacturer's instructions. The quality and quantity of cDNA was determined using the Agilent Bioanalyzer 2100 together with the mRNA Pico Assay (Agilent Technologies, Waldbronn, Germany) according to the manufacturer's instructions.
TaqMan low density array.
Real-time PCR analysis was performed using TaqMan Low Density Arrays (Applied Biosystems, Darmstadt, Germany). Real-time PCR primers and probes ("TaqMan Gene Expression Assays") for the rat genes listed in Table 1 were spotted onto a 384-well card (TaqMan Low Density Array). Eight samples were analyzed per card. Each sample was measured in triplicate in a single RT-PCR run. Five nanograms of single strand cDNA, mixed with qPCR Mastermix Plus (Eurogentec, Seraing, Belgium), in a total volume of 100 µl, was loaded per sample loading port. Thermal cycling and fluorescence detection were performed on Applied Biosystems ABI Prism 7900HT Sequence Detection System with ABI Prism 7900HT SDS Software 2.1. Forty-five cycles were run with the following parameters: 2 min at 50°C, 10 min at 94.5°C, and for each cycle 30 s at 97°C for denaturation and 1 min at 59.7°C for transcription. Analysis of gene expression values was performed using the efficiency-corrected comparative CT (threshold-cycle) method, determining target gene expression relative to either 18S rRNA or B2m endogenous control expression and relative to the control sample. Real-time PCR efficiencies for the above mentioned assays were determined by performing the reaction with a dilution series of cDNA (100, 10, 1, and 0.1 ng per sample loading port) prepared from control rat liver total RNA. Efficiency values and gene expression ratios were calculated as previously described by Tuschl and Mueller (2006
).
| RESULTS |
|---|
|
|
|---|
Animal Testing and Histopathology
After exposure to all nonhepatotoxicants as well as the UNC B, no histopathological alterations were found. On the other hand CCL4, ANIT, and AAP showed histopathological changes 72 h after treatment. CCL4 showed mild liver cell necrosis at ld that increased to severe liver cell damage combined with secondary inflammatory and minimal regenerative/proliferative effects after hd administration. Histopathological changes of ANIT and AAP were restricted to hd exposure and consisted of minimal liver cell necrosis. In addition, ANIT showed minimal secondary inflammatory and regenerative effects as well as moderate bile duct hyperplasia. The UNC A showed minimal liver cell necrosis and inflammation at low level exposure and increased to moderate liver cell damage combined with mild secondary effects. Histopathology evaluation is summarized in Table 2.
Principal Component Analysis of Model Compounds
In order to detect acute hepatotoxic effects of model compounds on the gene expression level, total RNA from rat livers given a single ld or hd of compound was isolated 6, 24, and 72 h after administration.
The unsupervised method, principal component analysis (PCA), is suited to separate natural subpopulations in an unbiased manner. To determine whether gene expression could separate samples treated with model hepatotoxic compounds at different time points and dose levels, PCA was used to visualize sample distribution. PCA analyses were conducted on all 550 genes on the microarray. Figure 1 shows all 12 compounds, including, time-matched vehicle controls (yellow), nonhepatotoxic (blue), and hepatotoxic compounds (others) 6, 24, and 72 h after hd treatment. Distinct separation of most hepatotoxicants, especially CCL4 and TET, into subclouds separated from the other experiments (including the time-matched vehicle controls and nonhepatotoxicants), was observed after 24 h. Experiments 6 h after low (data not shown) and hd treatment did not show distinguishable clusters, due to a high variability in the gene expression data. However, the hepatotoxicants ANIT and CCL4 were separated from the other experiments even 72 h after hd treatment. It is clear from Figure 1 that the TET experiments behaved differentially to the others (based on PCA). Even so, at 24-h TET treated animals showed a different gene expression than the corresponding vehicle control animals. By 72 h this was no longer the case.
|
Common Effects of Hepatotoxic Compounds
Gene expression profiles of all hepatotoxic and nonhepatotoxic compounds with a fold change deregulation of more than 1.5 and p < 0.05 were taken to find common significantly deregulated genes. Only for one condition, 24-h hd treatment, were five genes found to be deregulated by all six hepatotoxicants and not by nonhepatotoxicants (Table 3): ATP-binding cassette subfamily B (MDR/TAP) member 11, flavin containing monooxygenase (Fmo1), monoamine oxidase (Maob), liver glycogen phosphorylase (Pygl), and thioredoxin reductase (Txnrd1). The carbohydrate metabolism enzyme, Pygl, and the xenobiotic metabolism Phase 1 enzymes, Fmo1, and Maob, were significantly downregulated by 2–3, 2–10, or 1.6–3 fold. Abcb11, which is involved in transporter activity, was significantly downregulated by all hepatotoxicants except for ANIT which showed significant diametrical regulation of 1.8-fold. The oxidative stress enzyme, Txnrd1, was significantly upregulated by hepatotoxic compounds except for EE, which showed a small but significant downregulation 24 h after hd treatment.
Discrimination between Hepatotoxic and Nonhepatotoxic Compounds
Leave-one-out cross-validation (via SVM) using all 550 genes was performed for all normalized treated samples from all 12 compounds to distinguish between hepatotoxic and nonhepatotoxic model compounds. In Figure 2, tile plots show that 6 h after hd administration several compounds were misclassified (misclassification rate 58.3%). However, 24 h after hd treatment gene expression profiles allowed the correct classification of all compounds. After 72 h all nonhepatotoxic compounds were correctly predicted and three of the hepatotoxic compounds were predicted to be nonhepatotoxic (misclassification rate 25%). Only AAP, ANIT, and CCL4 were predicted to be hepatotoxic 72 h after administration. Gene expression profiles obtained from ld administration of all 12 compounds were incorrectly predicted at all time point (misclassification rates of 66.7% [6 h], 50% [24 h], and 66.7% [72 h] were obtained).
|
Gene Ranking Analysis
The ANOVA ranking method analysis was used to achieve a gene set which was responsible for the correct discrimination between hepatotoxic and nonhepatotoxic model compounds 24 h after hd treatment (see "Discrimination Between Hepatotoxic and Nonhepatotoxic Compounds"). The best performance concerning the optimal gene set with a misclassification rate of 0% (with which to perform the classification) was reached with a classifier based on 64 genes. In Table 4 the top-scoring 64 genes are described.
|
Verification of Illumina Gene Expression Data with Quantitative Real-Time PCR
Quantitative real-time PCR was used to verify the Illumina microarray data collected in this study. For a direct comparison, liver RNA from the same animals as used for Illumina microarray hybridization was used. Mean expression ratios of all samples from identically treated animals (three biological replicates) versus time-matched vehicle controls were compared between Illumina microarray and TaqMan Low density array technology platforms.
In Figure 3, the gene expression changes of the 24-h samples from hd CCL4-treated rats are shown as an example and data from all 12 compounds summarized in parentheses in Table 4. The real-time PCR expression patterns of the 14 genes, chosen for verification, matched the expression patterns obtained from the Illumina microarray hybridization for all compounds confirming the Illumina gene expression results.
|
Verification of the Predictive Screening Test System by Two Unknown Compounds
The possibility that gene expression profiles could classify an UNC was tested using the aforementioned model compounds as a training set. Samples derived from rats acutely exposed to two UNCs, A and B, for 24 h were taken for gene expression analysis on Illumina microarrays and then compared to the model previously described. UNC A was predicted to be hepatotoxic, UNC B as nonhepatotoxic (Fig. 4). As UNC A bromobenzene was used, an industrial chemical, which is known to cause hepatotoxicity by induction of liver necrosis (Heijne et al., 2004
|
| DISCUSSION |
|---|
|
|
|---|
The main focus of this study was to determine whether gene expression of a relatively small set of genes, known or suspected to be involved in hepatotoxicity, could discriminate between known hepatotoxic and nonhepatotoxic compounds. The ultimate goal would be to establish a predictive system for acute hepatotoxicity. Twelve compounds were evaluated at 6, 24, and 72 h and the expression profiles of the six hepatotoxicants could be differentiated from the six nonhepatotoxicants. By using bioinformatic cross-validation approaches and gene ranking analysis, characteristic genes were extracted and functionally classified. Only samples after hd administration showed predictive results. Ld treatment showed no discriminative patterns, which correlated well with the histopathological observations in these animals.
Effects of Hepatotoxic Compounds
All six hepatotoxic compounds showed individual gene expression profiles, reflecting compound-specific differences at the molecular level (data not shown). After 24-h hd treatment only five genes were commonly deregulated by these hepatotoxicants. The xenobiotic metabolism enzyme Fmo1 increases solubility and thereby ensures rapid excretion of xenobiotics (Eswaramoorthy et al., 2006
). Its downregulation may contribute to hepatotoxicity due to lack of elimination and emphasizes the importance of xenobiotic metabolism. The downregulation of Maob, which catalyzes the oxidative deamination of biogenic and xenobiotic amines (Zhou et al., 1995
), further supports this. The differences in fold change levels of these commonly deregulated genes can also be a sign that different maximal toxic time points exist, for example, 6 h for CCL4 and 12 h for AAP (Minami et al., 2005
). The carbohydrate metabolism enzyme Pygl, was downregulated by all hepatotoxicants indicating a decrease in glycogenolysis, since it catalyzes the first step in glycogen degradation (Bollen et al., 1998
). This could indicate a lack of resourcing energy, correlating with depleted glycogen stores which is seen histopathologically. Txndr1 is involved in protecting cells from oxidative stress (Deroo et al., 2004
; Neumann et al., 2003
). Its upregulation indicates the generation of reactive oxygen species, potentially contributing to DNA and protein damage. Txnrd1 is known to be upregulated by typical hepatotoxicants such as bromobenzene, thioacetamide, CCL4, and AAP (Minami et al., 2005
; Moto et al., 2005
) and is a sign of general cytotoxicity in the liver. Abcb11 plays a major role in the hepatobiliary excretion of bile salts (Strautnieks et al., 1998
). Downregulation by hepatotoxicants could result in severe hepatic effects, including intrahepatic cholestasis (Hirano et al., 2006
) and hepatic steatosis (Figge et al., 2004
).
Discrimination of Hepatotoxicants and Nonhepatotoxicants
Some of the nonhepatotoxicants also showed unique profiles. For example, CF is well-known to cause hepatocarcinogenesis (Baldwin et al., 1980
; Corton et al., 2000
), however, in our short-term study CF was expected and shown to be nonhepatotoxic. At the gene expression level only typical PPAR-
–mediated responses were observed (Corton et al., 2000
; Richert et al., 2003
).
A subset of genes was defined that allowed an accurate prediction of hepatotoxicity. This was seen in particular 24 h after hd treatment, reflecting the time point where most pronounced and characteristic deregulations occurred. At 6 h the high misclassification rate (58.3%) can probably be attributed to early stress responses caused by intraperitoneal dosing, immune responses, and animal handling. At 72 h, the model correctly classified only three of the hepatotoxic compounds. This may be an indication of the regeneration effects that have occurred after a single treatment (Mehendale, 2005
). The PCA showed that most compounds moved toward the main cluster, suggesting similar gene expression profiles. This is probably due to effective removal of the substance via metabolism and excretion, allowing the liver to recover. The three compounds, AAP, ANIT, and CCL4, predicted to be hepatotoxic after 72 h, reinforces the severity of hepatotoxicity of these compounds. Their distinct lasting effects on gene expression correlated very well with the histopathological findings taken at 72 h (only these three compounds showed changes). Interestingly, ANIT was predicted to be hepatotoxic only after 24 and 72 h and at 6 h was predicted to be nonhepatotoxic. This is consistent with the publication of Orsler et al. (1999)
who showed that histopathological changes after administration of ANIT to rats were observed only after 10–15 h. AAP was correctly predicted to be hepatotoxic at all time points, which emphasizes the fact that AAP is a potent, acute hepatotoxicant. This study is in concordance with Huang et al. (2004)
, who demonstrated that a dose of 4500 mg/kg AAP induced a distinct gene expression profile, which related directly to its hepatotoxicity.
The most distinct gene expression changes were observed after CCL4 exposure. This corresponds very well with the severe liver cell damage with secondary inflammation and regenerative/proliferation effects, which was seen histopathologically. The data support the fact that the estimated maximal toxic time point, based on gene expression profiles, was 6 h (Minami et al., 2005
).
General Comments to the Predictive Test System for Hepatotoxicants
It is worth noting that to establish this screening system, outbred rats were used to deliberately reflect the biological variance of animals within a certain range of genetic polymorphisms. This reflects better the normal human situation. Furthermore, the predictive test system demonstrated a certain robustness since the discrimination between hepatotoxic and nonhepatotoxic compounds was possible regardless of the different hepatotoxic characteristics (cholestasis, steatosis, or necrosis). The use of leave-one-out cross-validation on the one hand and the consideration that the data set of a model compound is composed of biological replicates (technical replicates were condensed) on the other hand indicate a robust test system, suggesting a potential application in the prediction of untested compounds.
Top-Scoring Genes for Class Prediction after 24 h
Twenty-four hours after hd treatment the best discrimination between hepatotoxicants and nonhepatotoxicants was achieved by the leave-one-out cross-validation method. Sixty-four genes (Table 4) were found to be responsible for this class prediction and reflected typical hepatotoxicity responses. The rank order is characterized by genes with different biological function/toxicological relevance. The top-scored gene Pygl was significantly downregulated only by hepatotoxicants corroborating the suggestion that Pygl could be an appropriate hepatotoxicity safety marker. The second highest scoring gene, tumor necrosis factor receptor superfamily member 1a (Tnfrsf1a), plays an important role in apoptosis by mediating TNF-
signaling, whose overexpression in acute disease states can lead to liver injury (Mohammed et al., 2004
; Volpes et al., 1992
; Yamada et al., 1998
). Keratin complex 1 acidic gene 18 (Krt1-18) forms intermediate filaments in liver (Oshima et al., 1996
). Disruption or absence of keratins in the liver can lead to mild hepatitis and increased sensitivity to hepatotoxins (Baribault et al., 1994
; Ku et al., 1996
). Caulin et al. (2000)
found that increases in Krt1-18 can resist TNF-induced apoptosis, suggesting Krt1-18 is involved in liver regeneration.
In general, the top-scoring genes showed the most pronounced deregulation in many biological categories, such as Phases 1 and 2 xenobiotic metabolism, lipid metabolism, and cell proliferation. Disturbances in lipid metabolism occurred by downregulation of genes such as ATP citrate lyase (Acly), which has an important role in supplying acetyl-CoA for both cholesterogenesis and lipogenesis (Pearce et al., 1998
). Therefore, the lipid biosynthesis level in the liver is low, suggesting low energy resources which may contribute to the pathogenesis of liver damage (Beigneux et al., 2004
). The DNA damage response gene, Gadd45a is typically upregulated by hepatotoxicants (Bartosiewicz et al., 2001
), which is in concordance with our data. The insulin-like growth factor binding protein 1 (Igfbp1) modulates insulin-like growth factor, which plays an essential role in the regulation of metabolism, growth, and development. Igfbp1 has been shown previously to be upregulated after acute liver injury (Scharf et al., 2004
), again confirming the relevance of our highest ranked genes.
Prediction of Two UNCs
The model created was used to predict the hepatotoxicity of two UNCs. UNC A was predicted to be hepatotoxic, which correlated well with the histopathological findings, a good prevalidation of our test system. The second UNC, UNC B, was predicted to be nonhepatotoxic, which correlated well with the lack of histopathological changes observed at 24 h. Classification analysis based on our 24-h model was able to predict UNC B to be hepatotoxic after 14 days of daily dosing (data not shown). This indicates that gene expression was affected by the compound after repeated dosage but not by a single dose.
In conclusion, we have presented evidence that the accurate discrimination between acute hepatotoxic compounds and nonhepatotoxicants, based on their gene expression profiles was possible 24-h postadministration. A prevalidation with two UNCs showed that the model we created was able to predict acute hepatotoxicants. The use of this model for more chronic, repeat-dose toxicity is still unclear. Preliminary data from UNC B suggest that the model can predict hepatotoxicity at 2 weeks. Therefore, further work is needed to elucidate hepatotoxicity signatures for other endpoints (e.g., repeated dose, other organ toxicity, and other species) and time points. Regarding the relatively small set of genes we conclude that focused gene microarrays are sufficient to classify compounds with respect to acute hepatotoxicity.
| SUPPLEMENTARY DATA |
|---|
|
|
|---|
Supplementary data are available online at http://toxsci.oxfordjournals.org/.
| ACKNOWLEDGMENTS |
|---|
The authors wish to thank Dr Anja von Heydebreck (Bio&Chemoinformatics, Merck KGaA) for her bioinformatics support and Dr Stefan O. Müller (Molecular Toxicology, Institute of Toxicology, Merck KGaA) for his comments and helpful discussion.
| REFERENCES |
|---|
|
|
|---|
Amacher DE, Martin BA. Tetracycline-induced steatosis in primary canine hepatocyte cultures. Fundam. Appl. Toxicol. (1997) 40:256–263.[CrossRef][Web of Science][Medline]
Baldwin JR, Witiak DT, Feller DR. Disposition of clofibrate in the rat. Acute and chronic administration. Biochem. Pharmacol. (1980) 29:3143–3154.[CrossRef][Web of Science][Medline]
Baribault H, Penner J, Iozzo RV, Wilson-Heiner M. Colorectal hyperplasia and inflammation in keratin 8-deficient FVB/N mice. Genes Dev. (1994) 8:2964–2973.
Bartosiewicz MJ, Jenkins D, Penn S, Emery J, Buckpitt A. Unique gene expression patterns in liver and kidney associated with exposure to chemical toxicants. J. Pharmacol. Exp. Ther. (2001) 297:895–905.
Beigneux AP, Kosinski C, Gavino B, Horton JD, Skarnes WC, Young SG. ATP-citrate lyase deficiency in the mouse. J. Biol. Chem. (2004) 279:9557–9564.
Bollen M, Keppens S, Stalmans W. Specific features of glycogen metabolism in the liver. Biochem. J. (1998) 336(Pt 1):19–31.[Web of Science][Medline]
Brattin WJ, Glende EA Jr, Recknagel RO. Pathological mechanisms in carbon tetrachloride hepatotoxicity. J. Free Radic. Biol. Med. (1985) 1:27–38.[CrossRef][Medline]
Caulin C, Ware CF, Magin TM, Oshima RG. Keratin-dependent, epithelial resistance to tumor necrosis factor-induced apoptosis. J. Cell Biol. (2000) 149:17–22.
Corton JC, Anderson SP, Stauber A. Central role of peroxisome proliferator-activated receptors in the actions of peroxisome proliferators. Annu. Rev. Pharmacol. Toxicol. (2000) 40:491–518.[CrossRef][Web of Science][Medline]
de Longueville F, Atienzar FA, Marcq L, Dufrane S, Evrard S, Wouters L, Leroux F, Bertholet V, Gerin B, Whomsley R, et al. Use of a low-density microarray for studying gene expression patterns induced by hepatotoxicants on primary cultures of rat hepatocytes. Toxicol. Sci. (2003) 75:378–392.
Deroo BJ, Hewitt SC, Peddada SD, Korach KS. Estradiol regulates the thioredoxin antioxidant system in the mouse uterus. Endocrinology (2004) 145:5485–5492.
Duggan DJ, Bittner M, Chen Y, Meltzer P, Trent JM. Expression profiling using cDNA microarrays. Nat. Genet. (1999) 21:10–14.[CrossRef][Web of Science][Medline]
Eberwine J, Yeh H, Miyashiro K, Cao Y, Nair S, Finnell R, Zettel M, Coleman P. Analysis of gene expression in single live neurons. Proc. Natl. Acad. Sci. U. S. A. (1992) 89:3010–3014.
Eswaramoorthy S, Bonanno JB, Burley SK, Swaminathan S. Mechanism of action of a flavin-containing monooxygenase. Proc. Natl. Acad. Sci. U. S. A. (2006) 103:9832–9837.
Figge A, Lammert F, Paigen B, Henkel A, Matern S, Korstanje R, Shneider BL, Chen F, Stoltenberg E, Spatz K, et al. Hepatic overexpression of murine Abcb11 increases hepatobiliary lipid secretion and reduces hepatic steatosis. J. Biol. Chem. (2004) 279:2790–2799.
Fromenty B, Pessayre D. Inhibition of mitochondrial beta-oxidation as a mechanism of hepatotoxicity. Pharmacol. Ther. (1995) 67:101–154.[CrossRef][Web of Science][Medline]
Galinsky VL. Automatic registration of microarray imagesI. Rectangular grid. Bioinformatics (2003) 19:1824–1831.
Garcia Monzon C, Noguerado A, Hidalgo S, Escudero V. [Cholestatic hepatitis caused by erythromycin estolate]. Rev. Clin. Esp. (1985) 177:420–421.[Web of Science][Medline]
Gunderson KL, Kruglyak S, Graige MS, Garcia F, Kermani BG, Zhao C, Che D, Dickinson T, Wickham E, Bierle J, et al. Decoding randomly ordered DNA arrays. Genome Res. (2004) 14:870–877.
Hamadeh HK, Bushel PR, Jayadev S, Martin K, DiSorbo O, Sieber S, Bennett L, Tennant R, Stoll R, Barrett JC, et al. Gene expression analysis reveals chemical-specific profiles. Toxicol. Sci. (2002) 67:219–231.
Heijne WH, Slitt AL, van Bladeren PJ, Groten JP, Klaassen CD, Stierum RH, van Ommen B. Bromobenzene-induced hepatotoxicity at the transcriptome level. Toxicol. Sci. (2004) 79:411–422.
Hirano H, Kurata A, Onishi Y, Sakurai A, Saito H, Nakagawa H, Nagakura M, Tarui S, Kanamori Y, Kitajima M, et al. High-speed screening and QSAR analysis of human ATP-binding cassette transporter ABCB11 (bile salt export pump) to predict drug-induced intrahepatic cholestasis. Mol. Pharm. (2006) 3:252–265.[CrossRef][Medline]
Huang Q, Jin X, Gaillard ET, Knight BL, Pack FD, Stoltz JH, Jayadev S, Blanchard KT. Gene expression profiling reveals multiple toxicity endpoints induced by hepatotoxicants. Mutat. Res. (2004) 549:147–167.[Web of Science][Medline]
James LP, Mayeux PR, Hinson JA. Acetaminophen-induced hepatotoxicity. Drug Metab. Dispos. (2003) 31:1499–1506.
Krell H, Hoke H, Pfaff E. Development of intrahepatic cholestasis by alpha-naphthylisothiocyanate in rats. Gastroenterology (1982) 82:507–514.[Web of Science][Medline]
Ku NO, Michie SA, Soetikno RM, Resurreccion EZ, Broome RL, Oshima RG, Omary MB. Susceptibility to hepatotoxicity in transgenic mice that express a dominant-negative human keratin 18 mutant. J. Clin. Invest. (1996) 98:1034–1046.[Web of Science][Medline]
Kuhn K, Baker SC, Chudin E, Lieu MH, Oeser S, Bennett H, Rigault P, Barker D, McDaniel TK, Chee MS. A novel, high-performance random array platform for quantitative gene expression profiling. Genome Res. (2004) 14:2347–2356.
Lau SS, Monks TJ. The contribution of bromobenzene to our current understanding of chemically-induced toxicities. Life Sci. (1988) 42:1259–1269.[CrossRef][Web of Science][Medline]
Maggioli J, Hoover A, Weng L. Toxicogenomic analysis methods for predictive toxicology. J. Pharmacol. Toxicol. Methods (2006) 53:31–37.[CrossRef][Medline]
Mehendale HM. Tissue repair: An important determinant of final outcome of toxicant-induced injury. Toxicol. Pathol. (2005) 33:41–51.
Mehendale HM, Roth RA, Gandolfi AJ, Klaunig JE, Lemasters JJ, Curtis LR. Novel mechanisms in chemically induced hepatotoxicity. FASEB J. (1994) 8:1285–1295.[Abstract]
Minami K, Saito T, Narahara M, Tomita H, Kato H, Sugiyama H, Katoh M, Nakajima M, Yokoi T. Relationship between hepatic gene expression profiles and hepatotoxicity in five typical hepatotoxicant-administered rats. Toxicol. Sci. (2005) 87:296–305.
Mohammed FF, Smookler DS, Taylor SE, Fingleton B, Kassiri Z, Sanchez OH, English JL, Matrisian LM, Au B, Yeh WC, et al. Abnormal TNF activity in Timp3-/- mice leads to chronic hepatic inflammation and failure of liver regeneration. Nat. Genet. (2004) 36:969–977.[CrossRef][Web of Science][Medline]
Moto M, Okamura M, Muto T, Kashida Y, Machida N, Mistumori K. Molecular pathological analysis on the mechanism of liver carcinogenesis in dicyclanil-treated mice. Toxicology (2005) 207:419–436.[CrossRef][Web of Science][Medline]
Neumann CA, Krause DS, Carman CV, Das S, Dubey DP, Abraham JL, Bronson RT, Fujiwara Y, Orkin SH, Van Etten RA. Essential role for the peroxiredoxin Prdx1 in erythrocyte antioxidant defence and tumour suppression. Nature (2003) 424:561–565.[CrossRef][Medline]
Orsler DJ, Ahmed-Choudhury J, Chipman JK, Hammond T, Coleman R. ANIT-induced disruption of biliary function in rat hepatocyte couplets. Toxicol. Sci. (1999) 47:203–210.
Oshima RG, Baribault H, Caulin C. Oncogenic regulation and function of keratins 8 and 18. Cancer Metastasis Rev. (1996) 15:445–471.[CrossRef][Web of Science][Medline]
Pearce NJ, Yates JW, Berkhout TA, Jackson B, Tew D, Boyd H, Camilleri P, Sweeney P, Gribble AD, Shaw A, et al. The role of ATP citrate-lyase in the metabolic regulation of plasma lipids Hypolipidaemic effects of SB–204990, a lactone prodrug of the potent ATP citrate-lyase inhibitor SB–201076. Biochem. J. (1998) 334(Pt 1):113–119.[Web of Science][Medline]
Prescott LF. Hepatotoxicity of mild analgesics. Br. J. Clin. Pharmacol. (1980) 10(Suppl. 2):373S–379S.[Medline]
Richert L, Lamboley C, Viollon-Abadie C, Grass P, Hartmann N, Laurent S, Heyd B, Mantion G, Chibout SD, Staedtler F. Effects of clofibric acid on mRNA expression profiles in primary cultures of rat, mouse and human hepatocytes. Toxicol. Appl. Pharmacol. (2003) 191:130–146.[CrossRef][Web of Science][Medline]
Scharf JG, Dombrowski F, Novosyadlyy R, Eisenbach C, Demori I, Kubler B, Braulke T. Insulin-like growth factor (IGF)-binding protein-1 is highly induced during acute carbon tetrachloride liver injury and potentiates the IGF-I-stimulated activation of rat hepatic stellate cells. Endocrinology (2004) 145:3463–3472.
Schena M, Shalon D, Davis RW, Brown PO. Quantitative monitoring of gene expression patterns with a complementary DNA microarray. Science (1995) 270:467–470.
Steemers FJ, Gunderson KL. Illumina, Inc. Pharmacogenomics (2005) 6:777–782.[CrossRef][Web of Science][Medline]
Steiner G, Suter L, Boess F, Gasser R, de Vera MC, Albertini S, Ruepp S. Discriminating different classes of toxicants by transcript profiling. Environ. Health Perspect. (2004) 112:1236–1248.[Web of Science][Medline]
Strautnieks SS, Bull LN, Knisely AS, Kocoshis SA, Dahl N, Arnell H, Sokal E, Dahan K, Childs S, Ling V, et al. A gene encoding a liver-specific ABC transporter is mutated in progressive familial intrahepatic cholestasis. Nat. Genet. (1998) 20:233–238.[CrossRef][Web of Science][Medline]
Thomas RS, Rank DR, Penn SG, Zastrow GM, Hayes KR, Pande K, Glover E, Silander T, Craven MW, Reddy JK, et al. Identification of toxicologically predictive gene sets using cDNA microarrays. Mol. Pharmacol. (2001) 60:1189–1194.
Tuschl G, Mueller SO. Effects of cell culture conditions on primary rat hepatocytes-cell morphology and differential gene expression. Toxicology (2006) 218:205–215.[CrossRef][Web of Science][Medline]
Ulrich R, Friend SH. Toxicogenomics and drug discovery: Will new technologies help us produce better drugs? Nat. Rev. Drug Discov. (2002) 1:84–88.[CrossRef][Web of Science][Medline]
Venkateswaran S, Pari L, Viswanathan P. Antiperoxidative effect of Livex, a herbal formulation against erythromycin estolate induced lipid peroxidation in rats. Phytother. Res. (1998) 12:1148–1171.
Volpes R, van den Oord JJ, De Vos R, Desmet VJ. Hepatic expression of type A and type B receptors for tumor necrosis factor. J. Hepatol. (1992) 14:361–369.[CrossRef][Web of Science][Medline]
Wang PY, Kaneko T, Tsukada H, Nakano M, Nakajima T, Sato A. Time courses of hepatic injuries induced by chloroform and by carbon tetrachloride: Comparison of biochemical and histopathological changes. Arch. Toxicol. (1997) 71:638–645.[CrossRef][Web of Science][Medline]
Waring JF, Jolly RA, Ciurlionis R, Lum PY, Praestgaard JT, Morfitt DC, Buratto B, Roberts C, Schadt E, Ulrich RG. Clustering of hepatotoxins based on mechanism of toxicity using gene expression profiles. Toxicol. Appl. Pharmacol. (2001) 175:28–42.[CrossRef][Web of Science][Medline]
Weber LW, Boll M, Stampfl A. Hepatotoxicity and mechanism of action of haloalkanes: Carbon tetrachloride as a toxicological model. Crit. Rev. Toxicol. (2003) 33:105–136.[Web of Science][Medline]
Yadetie F, Laegreid A, Bakke I, Kusnierczyk W, Komorowski J, Waldum HL, Sandvik AK. Liver gene expression in rats in response to the peroxisome proliferator-activated receptor-alpha agonist ciprofibrate. Physiol. Genomics. (2003) 15:9–19.
Yamada Y, Webber EM, Kirillova I, Peschon JJ, Fausto N. Analysis of liver regeneration in mice lacking type 1 or type 2 tumor necrosis factor receptor: Requirement for type 1 but not type 2 receptor. Hepatology (1998) 28:959–970.[CrossRef][Web of Science][Medline]
Yamamoto T, Kikkawa R, Yamada H, Horii I. Investigation of proteomic biomarkers in in vivo hepatotoxicity study of rat liver: Toxicity differentiation in hepatotoxicants. J. Toxicol. Sci. (2006) 31:49–60.[CrossRef][Medline]
Zhou BP, Lewis DA, Kwan SW, Abell CW. Flavinylation of monoamine oxidase B. J. Biol. Chem. (1995) 270:23653–23660.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
J. P. Luyendyk, G. H. Cantor, D. Kirchhofer, N. Mackman, B. L. Copple, and R. Wang Tissue factor-dependent coagulation contributes to {alpha}-naphthylisothiocyanate-induced cholestatic liver injury in mice Am J Physiol Gastrointest Liver Physiol, April 1, 2009; 296(4): G840 - G849. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. R. Fielden, A. Nie, M. McMillian, C. S. Elangbam, B. A. Trela, Y. Yang, R. T. Dunn II, Y. Dragan, R. Fransson-Stehen, M. Bogdanffy, et al. Interlaboratory Evaluation of Genomic Signatures for Predicting Carcinogenicity in the Rat Toxicol. Sci., May 1, 2008; 103(1): 28 - 34. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||





