Quality Control of Gene Expression Data Allows Accurate Quantification
of Differentially Expressed Biological Pathways

Ellen      Reed; Enrico      Ferrari; Mikhail      Soloviev

Abstract

Background: Gene expression signatures provide a promising diagnostic tool for many diseases, including cancer. However, there remain multiple issues related to the quality of gene expression data, which may impede the analysis and interpretation of differential gene expression in cancer.

Objective: We aimed to address existing issues related to the quality of gene expression data and to devise improved quality control (QC) and expression data processing procedures.

Methods: Linear regression analysis was applied to gene expression datasets generated from diluted and pre-mixed matched breast cancer and normal breast tissue samples. Datapoint outliers were identified and removed, and accurate expression values corresponding to cancer and normal tissues were recalculated.

Results: We achieved a 27% increase in the number of identifiable differentially regulated genes and a similar reduction in the number of false positives identified from microarray DEG data. Our approach reduced technical errors and improved the accuracy and precision of determining the degree of DEG but did not remove biological outliers, such as naturally variably expressed genes. We also determined the linear dynamic range of microarray assay directly from expression data, which allowed accurate quantification of differentially expressed entire pathways.

Conclusion: The improved QC allowed accurate discrimination of genes by the degree of their upregulation, which helped to reveal an intricate and highly tuned network of biological pathways and their regulation in cancer. We were able, for the first time, to quantify the degree of transcriptional upregulation of entire individual biological pathways upregulated in breast cancer. It can be concluded that the vast majority of DEG data that are publicly available today may have been generated using sub-optimal experimental design, lacking preparations required for genuinely accurate and quantitative analysis.

Graphical Abstract

[1]
Reue K. mRNA quantitation techniques: Considerations for experimental design and application. J Nutr  1998; 128(11): 2038-44.
 [http://dx.doi.org/10.1093/jn/128.11.2038] [PMID:  9808663]

[2]
de Sena Brandine G, Smith AD. Falco: high-speed FastQC emulation for quality control of sequencing data. F1000 Res  2019; 8: 1874.
 [http://dx.doi.org/10.12688/f1000research.21142.1] [PMID:  33552473]

[3]
Babraham Bioinformatics.  Available from: https://www.bioinformatics.babraham.ac.uk/projects/fastqc/

[4]
Patel RK, Jain M. (2012) NGS QC Toolkit: A Toolkit for Quality Control of Next Generation Sequencing Data. PLoS One  7(2): e30619.
 [http://dx.doi.org/10.1371/journal.pone.0030619]

[5]
NGSQCToolkit version 2.3.  Available from: https://github.com/mjain-lab/NGSQCToolkit

[6]
Wang L, Wang S, Li W. RSeQC: quality control of RNA-seq experiments. Bioinformatics  2012; 28(16): 2184-5.
 [http://dx.doi.org/10.1093/bioinformatics/bts356] [PMID:  22743226]

[7]
RSeQC. An RNA-seq Quality Control Package.  Available from: http://rseqc.sourceforge.net/

[8]
Hartley SW, Mullikin JC. QoRTs: a comprehensive toolset for quality control and data processing of RNA-Seq experiments. BMC Bioinformatics  2015; 16(1): 224.
 [http://dx.doi.org/10.1186/s12859-015-0670-5] [PMID:  26187896]

[9]
QoRTs. Quality of RNA-seq Tool-Set  Available from: https://hartleys.github.io/QoRTs/

[10]
Zhou Q, Su X, Jing G, Chen S, Ning K. RNA-QC-chain: comprehensive and fast quality control for RNA-Seq data. BMC Genomics  2018; 19(1): 144.
 [http://dx.doi.org/10.1186/s12864-018-4503-6] [PMID:  29444661]

[11]
Yang IS, Kim S. Analysis of whole transcriptome sequencing data: Workflow and Software. Genomics Inform  2015; 13(4): 119-25.
 [http://dx.doi.org/10.5808/GI.2015.13.4.119] [PMID:  26865842]

[12]
Sheng Q, Vickers K, Zhao S, et al. Multi-perspective quality control of Illumina RNA sequencing data analysis. Brief Funct Genomics  2017; 16(4): 194-204.
 [PMID:  27687708]

[13]
Conesa A, Madrigal P, Tarazona S, et al. A survey of best practices for RNA-seq data analysis. Genome Biol  2016; 17(1): 13.
 [http://dx.doi.org/10.1186/s13059-016-0881-8] [PMID:  26813401]

[14]
Cornwell M, Vangala M, Taing L, et al. VIPER: Visualization Pipeline for RNA-seq, a Snakemake workflow for efficient and complete RNA-seq analysis. BMC Bioinformatics  2018; 19(1): 135.
 [http://dx.doi.org/10.1186/s12859-018-2139-9] [PMID:  29649993]

[15]
Zhang X, Jonassen I. RASflow: an RNA-Seq analysis workflow with Snakemake. BMC Bioinformatics  2020; 21(1): 110.
 [http://dx.doi.org/10.1186/s12859-020-3433-x] [PMID:  32183729]

[16]
Nextflow-RNASeq.  Available from: https://www.sanger.ac.uk/tool/nextflow-rnaseq/

[17]
Federico A, Karagiannis T, Karri K, et al. Pipeliner: A nextflow-based framework for the definition of sequencing data processing pipelines. Front Genet  2019; 10: 614.
 [http://dx.doi.org/10.3389/fgene.2019.00614] [PMID:  31316552]

[18]
Lataretu M, Hölzer M. RNAflow: An effective and simple RNA-Seq differential gene expression pipeline using nextflow. Genes (Basel)  2020; 11(12): 1487.
 [http://dx.doi.org/10.3390/genes11121487] [PMID:  33322033]

[19]
Oshlack A, Emslie D, Corcoran L, Smyth GK. Normalization of boutique two-color microarrays with a high proportion of differentially expressed probes. Genome Biol  2007; 8(1): R2.
 [http://dx.doi.org/10.1186/gb-2007-8-1-r2] [PMID:  17204140]

[20]
Ritchie ME, Silver J, Oshlack A, et al. A comparison of background correction methods for two-colour microarrays. Bioinformatics  2007; 23(20): 2700-7.
 [http://dx.doi.org/10.1093/bioinformatics/btm412] [PMID:  17720982]

[21]
Ritchie ME, Phipson B, Wu D, et al. limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res  2015; 43(7): e47.
 [http://dx.doi.org/10.1093/nar/gkv007] [PMID:  25605792]

[22]
Smyth GK, Michaud J, Scott HS. Use of within-array replicate spots for assessing differential expression in microarray experiments. Bioinformatics  2005; 21(9): 2067-75.
 [http://dx.doi.org/10.1093/bioinformatics/bti270] [PMID:  15657102]

[23]
Kauffmann A, Huber W. Microarray data quality control improves the detection of differentially expressed genes. Genomics  2010; 95(3): 138-42.
 [http://dx.doi.org/10.1016/j.ygeno.2010.01.003] [PMID:  20079422]

[24]
Phipson B, Lee S, Majewski IJ, Alexander WS, Smyth GK. Robust hyperparameter estimation protects against hypervariable genes and improves power to detect differential expression. Ann Appl Stat  2016; 10(2): 946-63.
 [http://dx.doi.org/10.1214/16-AOAS920] [PMID:  28367255]

[25]
Alanni R, Hou J, Azzawi H, Xiang Y. A novel gene selection algorithm for cancer classification using microarray datasets. BMC Med Genomics  2019; 12(1): 10.
 [http://dx.doi.org/10.1186/s12920-018-0447-6] [PMID:  30646919]

[26]
Sun M, Shao X, Wang Y. Microarray data analysis for transcriptome profiling. Methods Mol Biol  2018; 1751: 17-33.
 [http://dx.doi.org/10.1007/978-1-4939-7710-9_2] [PMID:  29508287]

[27]
Mohammed A, Biegert G, Adamec J, Helikar T. Identification of potential tissue-specific cancer biomarkers and development of cancer versus normal genomic classifiers. Oncotarget  2017; 8(49): 85692-715.
 [http://dx.doi.org/10.18632/oncotarget.21127] [PMID:  29156751]

[28]
Alhenawi E, Al-Sayyed R, Hudaib A, Mirjalili S. Feature selection methods on gene expression microarray data for cancer classification: A systematic review. Comput Biol Med  2022; 140: 105051.
 [http://dx.doi.org/10.1016/j.compbiomed.2021.105051] [PMID:  34839186]

[29]
Narrandes S, Xu W. Gene expression detection assay for cancer clinical use. J Cancer  2018; 9(13): 2249-65.
 [http://dx.doi.org/10.7150/jca.24744] [PMID:  30026820]

[30]
Mancuso CA, Canfield JL, Singla D, Krishnan A. A flexible, interpretable, and accurate approach for imputing the expression of unmeasured genes. Nucleic Acids Res  2020; 48(21): e125.
 [http://dx.doi.org/10.1093/nar/gkaa881] [PMID:  33074331]

[31]
Castillo D, Gálvez JM, Herrera LJ, Román BS, Rojas F, Rojas I. Integration of RNA-Seq data with heterogeneous microarray data for breast cancer profiling. BMC Bioinformatics  2017; 18(1): 506.
 [http://dx.doi.org/10.1186/s12859-017-1925-0] [PMID:  29157215]

[32]
GEO Search.  Available from: https://www.ncbi.nlm.nih.gov/geo/info/qqtutorial.html

[33]
Kourou K, Exarchos TP, Exarchos KP, Karamouzis MV, Fotiadis DI. Machine learning applications in cancer prognosis and prediction. Comput Struct Biotechnol J  2015; 13: 8-17.
 [http://dx.doi.org/10.1016/j.csbj.2014.11.005] [PMID:  25750696]

[34]
Daoud M, Mayo M. A survey of neural network-based cancer prediction models from microarray data. Artif Intell Med  2019; 97: 204-14.
 [http://dx.doi.org/10.1016/j.artmed.2019.01.006] [PMID:  30797633]

[35]
Shieh AD, Hung YS. Detecting outlier samples in microarray data. Stat Appl Genet Mol Biol  2009; 8(1): 1-24.
 [http://dx.doi.org/10.2202/1544-6115.1426] [PMID:  19222380]

[36]
Ritchie ME, Diyagama D, Neilson J, et al. Empirical array quality weights in the analysis of microarray data. BMC Bioinformatics  2006; 7(1): 261.
 [http://dx.doi.org/10.1186/1471-2105-7-261] [PMID:  16712727]

[37]
Siangphoe U, Archer KJ, Mukhopadhyay ND. Classical and Bayesian random-effects meta-analysis models with sample quality weights in gene expression studies. BMC Bioinformatics  2019; 20(1): 18.
 [http://dx.doi.org/10.1186/s12859-018-2491-9] [PMID:  30626315]

[38]
Kauffmann A, Gentleman R, Huber W. arrayQualityMetrics-A bioconductor package for quality assessment of microarray data. Bioinformatics  2009; 25(3): 415-6.
 [http://dx.doi.org/10.1093/bioinformatics/btn647] [PMID:  19106121]

[39]
Johansson P, Häkkinen J. Improving missing value imputation of microarray data by using spot quality weights. BMC Bioinformatics  2006; 7(1): 306.
 [http://dx.doi.org/10.1186/1471-2105-7-306] [PMID:  16780582]

[40]
Law CW, Chen Y, Shi W, Smyth GK. voom: precision weights unlock linear model analysis tools for RNA-seq read counts. Genome Biol  2014; 15(2): R29.
 [http://dx.doi.org/10.1186/gb-2014-15-2-r29] [PMID:  24485249]

[41]
Liu R, Holik AZ, Su S, et al. Why weight? Modelling sample and observational level variability improves power in RNA-seq analyses. Nucleic Acids Res  2015; 43(15): e97.
 [http://dx.doi.org/10.1093/nar/gkv412] [PMID:  25925576]

[42]
arrayQualityMetrics.  Available from: https://www.bioconductor.org/packages/release/bioc/html/arrayQualityMetrics.html

[43]
Kumar G, Ertel A, Feldman G, Kupper J, Fortina P. iSeqQC: a tool for expression-based quality control in RNA sequencing. BMC Bioinformatics  2020; 21(1): 56.
 [http://dx.doi.org/10.1186/s12859-020-3399-8] [PMID:  32054449]

[44]
Raman T, O’Connor TP, Hackett NR, et al. Quality control in microarray assessment of gene expression in human airway epithelium. BMC Genomics  2009; 10(1): 493.
 [http://dx.doi.org/10.1186/1471-2164-10-493] [PMID:  19852842]

[45]
Bissels U, Wild S, Tomiuk S, et al. Absolute quantification of microRNAs by using a universal reference. RNA  2009; 15(12): 2375-84.
 [http://dx.doi.org/10.1261/rna.1754109] [PMID:  19861428]

[46]
Yang J. Identification of novel biomarkers, MUC5AC, MUC1, KRT7, GAPDH, CD44 for gastric cancer. Med Oncol  2020; 37(5): 34.
 [http://dx.doi.org/10.1007/s12032-020-01362-0] [PMID:  32219571]

[47]
Gui H, Gong Q, Jiang J, Liu M, Li H. Identification of the hub genes in Alzheimer’s disease. Comput Math Methods Med  2021; 2021: 1-8.
 [http://dx.doi.org/10.1155/2021/6329041] [PMID:  34326892]

[48]
Bednarz-Misa I, Neubauer K, Zacharska E, Kapturkiewicz B, Krzystek-Korpacka M. Whole blood ACTB, B2M and GAPDH expression reflects activity of inflammatory bowel disease, advancement of colorectal cancer, and correlates with circulating inflammatory and angiogenic factors: Relevance for real time quantitative PCR. Adv Clin Exp Med  2020; 29(5): 547-56.
 [http://dx.doi.org/10.17219/acem/118845] [PMID:  32424999]

[49]
Valenti MT, Bertoldo F, Dalle Carbonare L, et al. The effect of bisphosphonates on gene expression: GAPDH as a housekeeping or a new target gene? BMC Cancer  2006; 6(1): 49.
 [http://dx.doi.org/10.1186/1471-2407-6-49] [PMID:  16515701]

[50]
Hansen CN, Ketabi Z, Rosenstierne MW, Palle C, Boesen HC, Norrild B. Expression of CPEB, GAPDH and U6snRNA in cervical and ovarian tissue during cancer development. Acta Pathol Microbiol Scand Suppl  2009; 117(1): 53-9.
 [http://dx.doi.org/10.1111/j.1600-0463.2008.00015.x] [PMID:  19161537]

[51]
Deindl E, Boengler K, van Royen N, Schaper W. Differential expression of GAPDH and beta3-actin in growing collateral arteries. Mol Cell Biochem  2002; 236(1/2): 139-46.
 [http://dx.doi.org/10.1023/A:1016166127465] [PMID:  12190113]

[52]
GEO - GSE124646.  Available from: https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE124646

[53]
GEO - GSE33116.  Available from: https://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE33116

[54]
Barry R, Diggle T, Terrett J, Soloviev M. Competitive assay formats for high-throughput affinity arrays. SLAS Discov  2003; 8(3): 257-63.
 [http://dx.doi.org/10.1177/1087057103008003003] [PMID:  12857379]

[55]
Hebenstreit D, Fang M, Gu M, Charoensawan V, van Oudenaarden A, Teichmann SA. RNA sequencing reveals two major classes of gene expression levels in metazoan cells. Mol Syst Biol  2011; 7(1): 497.
 [http://dx.doi.org/10.1038/msb.2011.28] [PMID:  21654674]

[56]
Piccolo SR, Withers MR, Francis OE, Bild AH, Johnson WE. Multiplatform single-sample estimates of transcriptional activation. Proceedings of the National Academy of Sciences - PNAS  110: 17778-83.
 [http://dx.doi.org/10.1073/pnas.1305823110]

[57]
Ghavi-Helm Y, Klein FA, Pakozdi T, et al. Enhancer loops appear stable during development and are associated with paused polymerase. Nature  2014; 512(7512): 96-100.
 [http://dx.doi.org/10.1038/nature13417] [PMID:  25043061]

[58]
Lauria A, Peirone S, Giudice MD, et al. Identification of altered biological processes in heterogeneous RNA-sequencing data by discretization of expression profiles. Nucleic Acids Res  2020; 48(4): 1730-47.
 [http://dx.doi.org/10.1093/nar/gkz1208] [PMID:  31889184]

[59]
Nagaraj N, Wisniewski JR, Geiger T, et al. Deep proteome and transcriptome mapping of a human cancer cell line. Mol Syst Biol  2011; 7(1): 548.
 [http://dx.doi.org/10.1038/msb.2011.81] [PMID:  22068331]

[60]
Hartwell LH, Kastan MB. Cell cycle control and cancer. Science  1994; 266(5192): 1821-8.
 [http://dx.doi.org/10.1126/science.7997877] [PMID:  7997877]

[61]
Sager R. Expression genetics in cancer: Shifting the focus from DNA to RNA. Proc Natl Acad Sci USA  1997; 94(3): 952-5.
 [http://dx.doi.org/10.1073/pnas.94.3.952] [PMID:  9023363]

[62]
Croce CM. Oncogenes and cancer. N Engl J Med  2008; 358(5): 502-11.
 [http://dx.doi.org/10.1056/NEJMra072367] [PMID:  18234754]

[63]
Matziari M, Dive V, Yiotakis A. Matrix metalloproteinase 11 (MMP-11; stromelysin-3) and synthetic inhibitors. Med Res Rev  2007; 27(4): 528-52.
 [http://dx.doi.org/10.1002/med.20066] [PMID:  16710861]

[64]
An X, Xu F, Luo R, et al. The prognostic significance of topoisomerase II alpha protein in early stage luminal breast cancer. BMC Cancer  2018; 18(1): 331.
 [http://dx.doi.org/10.1186/s12885-018-4170-7] [PMID:  29587760]

[65]
Busse DC, Habgood-Coote D, Clare S, et al. Interferon-induced protein 44 and interferon-induced protein 44-like restrict replication of respiratory syncytial virus. J Virol  2020; 94(18): e00297-20.
 [http://dx.doi.org/10.1128/JVI.00297-20] [PMID:  32611756]

[66]
Nallanthighal S, Heiserman JP, Cheon DJ. Collagen Type XI Alpha 1 (COL11A1): A novel biomarker and a key player in cancer. Cancers (Basel)  2021; 13(5): 935.
 [http://dx.doi.org/10.3390/cancers13050935] [PMID:  33668097]

[67]
Gibbons JA, Kanwar RK, Kanwar JR. Lactoferrin and cancer in different cancer models. Front Biosci (Schol Ed)  2011; S3(1): 1080-8.
 [http://dx.doi.org/10.2741/212] [PMID:  21622257]

[68]
Cho SH, Kuo IY, Lu PJF, et al. Rab37 mediates exocytosis of secreted frizzled-related protein 1 to inhibit Wnt signaling and thus suppress lung cancer stemness. Cell Death Dis  2018; 9(9): 868.
 [http://dx.doi.org/10.1038/s41419-018-0915-0] [PMID:  30158579]

[69]
Guaita-Esteruelas S, Gumà J, Masana L, Borràs J. The peritumoural
adipose tissue microenvironment and cancer. The roles of fatty
acid binding protein 4 and fatty acid binding protein 5. Mol Cell Endocrinol  2018; 462(Pt B): 107-8.
 [http://dx.doi.org/10.1016/j.mce.2017.02.002] [PMID: 28163102]

[70]
Rassart E, Desmarais F, Najyb O, Bergeron KF, Mounier C, Apolipoprotein D. Apolipoprotein D. Gene  2020; 756: 144874.
 [http://dx.doi.org/10.1016/j.gene.2020.144874] [PMID:  32554047]

Cite As

Current Bioinformatics

Quality Control of Gene Expression Data Allows Accurate Quantification of Differentially Expressed Biological Pathways

Abstract

Graphical Abstract