scholarly journals Model, Integrate, Search... Repeat: A Sound Approach to Building Integrated Repositories of Genomic Data

2022 ◽  
pp. 89-99
Author(s):  
Anna Bernasconi
Keyword(s):  
Genomic Data ◽  
Transformation Process ◽  
Data Sources ◽  
Data Repositories ◽  
Genomic Data Integration ◽  
Data Formats ◽  
Public Data ◽  
The Common ◽  
Human Genomic ◽  
User Friendly

AbstractA wealth of public data repositories is available to drive genomics and clinical research. However, there is no agreement among the various data formats and models; in the common practice, data sources are accessed one by one, learning their specific descriptions with tedious efforts. In this context, the integration of genomic data and of their describing metadata becomes—at the same time—an important, difficult, and well-recognized challenge. In this chapter, after overviewing the most important human genomic data players, we propose a conceptual model of metadata and an extended architecture for integrating datasets, retrieved from a variety of data sources, based upon a structured transformation process; we then describe a user-friendly search system providing access to the resulting consolidated repository, enriched by a multi-ontology knowledge base. Inspired by our work on genomic data integration, during the COVID-19 pandemic outbreak we successfully re-applied the previously proposed model-build-search paradigm, building on the analogies among the human and viral genomics domains. The availability of conceptual models, related databases, and search systems for both humans and viruses will provide important opportunities for research, especially if virus data will be connected to its host, provider of genomic and phenotype information.

scholarly journals metaXplor: an interactive viral and microbial metagenomic data manager

GigaScience ◽  
2021 ◽  
Vol 10 (2) ◽  
Author(s):  
Guilhem Sempéré ◽  
Adrien Pétel ◽  
Magsen Abbé ◽  
Pierre Lefeuvre ◽  
Philippe Roumagnac ◽  
...  
Keyword(s):  
Heterogeneous Data ◽  
Metagenomic Data ◽  
Online Data ◽  
Data Repositories ◽  
Ongoing Research ◽  
Efficient Management ◽  
Public Data ◽  
Reference Databases ◽  
Interactive Data ◽  
User Friendly

Abstract Background Efficiently managing large, heterogeneous data in a structured yet flexible way is a challenge to research laboratories working with genomic data. Specifically regarding both shotgun- and metabarcoding-based metagenomics, while online reference databases and user-friendly tools exist for running various types of analyses (e.g., Qiime, Mothur, Megan, IMG/VR, Anvi'o, Qiita, MetaVir), scientists lack comprehensive software for easily building scalable, searchable, online data repositories on which they can rely during their ongoing research. Results metaXplor is a scalable, distributable, fully web-interfaced application for managing, sharing, and exploring metagenomic data. Being based on a flexible NoSQL data model, it has few constraints regarding dataset contents and thus proves useful for handling outputs from both shotgun and metabarcoding techniques. By supporting incremental data feeding and providing means to combine filters on all imported fields, it allows for exhaustive content browsing, as well as rapid narrowing to find specific records. The application also features various interactive data visualization tools, ways to query contents by BLASTing external sequences, and an integrated pipeline to enrich assignments with phylogenetic placements. The project home page provides the URL of a live instance allowing users to test the system on public data. Conclusion metaXplor allows efficient management and exploration of metagenomic data. Its availability as a set of Docker containers, making it easy to deploy on academic servers, on the cloud, or even on personal computers, will facilitate its adoption.

scholarly journals Ontology-Based Data Access: A Survey

2018 ◽  
Author(s):  
Guohui Xiao ◽  
Diego Calvanese ◽  
Roman Kontchakov ◽  
Domenico Lembo ◽  
Antonella Poggi ◽  
...  
Keyword(s):  
Data Access ◽  
Data Sources ◽  
Relational Data ◽  
Data Repositories ◽  
The Past ◽  
Future Challenges ◽  
Access To Data ◽  
User Friendly ◽  
Theoretical Results

We present the framework of ontology-based data access, a semantic paradigm for providing a convenient and user-friendly access to data repositories, which has been actively developed and studied in the past decade. Focusing on relational data sources, we discuss the main ingredients of ontology-based data access, key theoretical results, techniques, applications and future challenges.

The Changing Landscape of Asian Entrepreneurship, Minority Banks, and Community Development

2011 ◽  
Vol 9 (1-2) ◽  
pp. 78-90
Author(s):  
Tarry Hum
Keyword(s):  
New York ◽  
New York City ◽  
Data Collection ◽  
Community Development ◽  
Real Estate ◽  
York City ◽  
Commercial Real Estate ◽  
Data Sources ◽  
Real Estate Development ◽  
Public Data

This policy brief examines minority banks and their lending practices in New York City. By synthesizing various public data sources, this policy brief finds that Asian banks now make up a majority of minority banks, and their loans are concentrated in commercial real estate development. This brief underscores the need for improved data collection and access to research minority banks and the need to improve their contributions to equitable community development and sustainability.

scholarly journals Prioritising recommendations following analyses of adverse events in healthcare: a systematic review

2020 ◽  
Vol 9 (4) ◽  
pp. e000843
Author(s):  
Kelly Bos ◽  
Maarten J van der Laan ◽  
Dave A Dongelmans
Keyword(s):  
Systematic Review ◽  
Adverse Events ◽  
Data Extraction ◽  
Data Sources ◽  
Cochrane Library ◽  
High Quality ◽  
Data Synthesis ◽  
Study Selection ◽  
Personal Opinion ◽  
User Friendly

PurposeThe purpose of this systematic review was to identify an appropriate method—a user-friendly and validated method—that prioritises recommendations following analyses of adverse events (AEs) based on objective features.Data sourcesThe electronic databases PubMed/MEDLINE, Embase (Ovid), Cochrane Library, PsycINFO (Ovid) and ERIC (Ovid) were searched.Study selectionStudies were considered eligible when reporting on methods to prioritise recommendations.Data extractionTwo teams of reviewers performed the data extraction which was defined prior to this phase.Results of data synthesisEleven methods were identified that are designed to prioritise recommendations. After completing the data extraction, none of the methods met all the predefined criteria. Nine methods were considered user-friendly. One study validated the developed method. Five methods prioritised recommendations based on objective features, not affected by personal opinion or knowledge and expected to be reproducible by different users.ConclusionThere are several methods available to prioritise recommendations following analyses of AEs. All these methods can be used to discuss and select recommendations for implementation. None of the methods is a user-friendly and validated method that prioritises recommendations based on objective features. Although there are possibilities to further improve their features, the ‘Typology of safety functions’ by de Dianous and Fiévez, and the ‘Hierarchy of hazard controls’ by McCaughan have the most potential to select high-quality recommendations as they have only a few clearly defined categories in a well-arranged ordinal sequence.

Improvements for research data repositories: The case of text spam

2021 ◽  
pp. 016555152199863
Author(s):  
Ismael Vázquez ◽  
María Novo-Lourés ◽  
Reyes Pavón ◽  
Rosalía Laza ◽  
José Ramón Méndez ◽  
...  
Keyword(s):  
Web Application ◽  
Research Data ◽  
Data Sets ◽  
Data Repositories ◽  
Software Applications ◽  
Public Data ◽  
Protection Mechanisms ◽  
Experimental Protocols ◽  
Learning Research ◽  
Processing Steps

Current research has evolved in such a way scientists must not only adequately describe the algorithms they introduce and the results of their application, but also ensure the possibility of reproducing the results and comparing them with those obtained through other approximations. In this context, public data sets (sometimes shared through repositories) are one of the most important elements for the development of experimental protocols and test benches. This study has analysed a significant number of CS/ML ( Computer Science/ Machine Learning) research data repositories and data sets and detected some limitations that hamper their utility. Particularly, we identify and discuss the following demanding functionalities for repositories: (1) building customised data sets for specific research tasks, (2) facilitating the comparison of different techniques using dissimilar pre-processing methods, (3) ensuring the availability of software applications to reproduce the pre-processing steps without using the repository functionalities and (4) providing protection mechanisms for licencing issues and user rights. To show the introduced functionality, we created STRep (Spam Text Repository) web application which implements our recommendations adapted to the field of spam text repositories. In addition, we launched an instance of STRep in the URL https://rdata.4spam.group to facilitate understanding of this study.

scholarly journals SHI7 Is a Self-Learning Pipeline for Multipurpose Short-Read DNA Quality Control

mSystems ◽  
2018 ◽  
Vol 3 (3) ◽  
Author(s):  
Gabriel A. Al-Ghalith ◽  
Benjamin Hillmann ◽  
Kaiwei Ang ◽  
Robin Shields-Cutler ◽  
Dan Knights
Keyword(s):  
Quality Control ◽  
Dna Sequences ◽  
Sequence Data ◽  
Background Knowledge ◽  
Sequencing Technology ◽  
Data Set ◽  
Short Read ◽  
Dna Quality ◽  
Public Data ◽  
User Friendly

ABSTRACT Next-generation sequencing technology is of great importance for many biological disciplines; however, due to technical and biological limitations, the short DNA sequences produced by modern sequencers require numerous quality control (QC) measures to reduce errors, remove technical contaminants, or merge paired-end reads together into longer or higher-quality contigs. Many tools for each step exist, but choosing the appropriate methods and usage parameters can be challenging because the parameterization of each step depends on the particularities of the sequencing technology used, the type of samples being analyzed, and the stochasticity of the instrumentation and sample preparation. Furthermore, end users may not know all of the relevant information about how their data were generated, such as the expected overlap for paired-end sequences or type of adaptors used to make informed choices. This increasing complexity and nuance demand a pipeline that combines existing steps together in a user-friendly way and, when possible, learns reasonable quality parameters from the data automatically. We propose a user-friendly quality control pipeline called SHI7 (canonically pronounced “shizen”), which aims to simplify quality control of short-read data for the end user by predicting presence and/or type of common sequencing adaptors, what quality scores to trim, whether the data set is shotgun or amplicon sequencing, whether reads are paired end or single end, and whether pairs are stitchable, including the expected amount of pair overlap. We hope that SHI7 will make it easier for all researchers, expert and novice alike, to follow reasonable practices for short-read data quality control. IMPORTANCE Quality control of high-throughput DNA sequencing data is an important but sometimes laborious task requiring background knowledge of the sequencing protocol used (such as adaptor type, sequencing technology, insert size/stitchability, paired-endedness, etc.). Quality control protocols typically require applying this background knowledge to selecting and executing numerous quality control steps with the appropriate parameters, which is especially difficult when working with public data or data from collaborators who use different protocols. We have created a streamlined quality control pipeline intended to substantially simplify the process of DNA quality control from raw machine output files to actionable sequence data. In contrast to other methods, our proposed pipeline is easy to install and use and attempts to learn the necessary parameters from the data automatically with a single command.

scholarly journals SSFinder: High Throughput CRISPR-Cas Target Sites Prediction Tool

2014 ◽  
Vol 2014 ◽  
pp. 1-4 ◽  
Author(s):  
Santosh Kumar Upadhyay ◽  
Shailesh Sharma
Keyword(s):  
Operating Systems ◽  
High Throughput ◽  
Genomic Data ◽  
Prediction Tool ◽  
High Demand ◽  
Specific Target ◽  
Target Sites ◽  
High Throughput Detection ◽  
User Friendly

Clustered regularly interspaced short palindromic repeats (CRISPR) and CRISPR-associated protein (Cas) system facilitates targeted genome editing in organisms. Despite high demand of this system, finding a reliable tool for the determination of specific target sites in large genomic data remained challenging. Here, we report SSFinder, a python script to perform high throughput detection of specific target sites in large nucleotide datasets. The SSFinder is a user-friendly tool, compatible with Windows, Mac OS, and Linux operating systems, and freely available online.

scholarly journals SpiderSeqR: an R package for crawling the web of high-throughput multi-omic data repositories for data-sets and annotation

2020 ◽  
Author(s):  
Anna M. Sozanska ◽  
Charles Fletcher ◽  
Dóra Bihary ◽  
Shamith A. Samarajiwa
Keyword(s):  
High Throughput ◽  
R Package ◽  
Data Reuse ◽  
Massively Parallel ◽  
Data Sets ◽  
Similar Data ◽  
Data Generation ◽  
Data Repositories ◽  
Public Data ◽  
Omic Data

AbstractMore than three decades ago, the microarray revolution brought about high-throughput data generation capability to biology and medicine. Subsequently, the emergence of massively parallel sequencing technologies led to many big-data initiatives such as the human genome project and the encyclopedia of DNA elements (ENCODE) project. These, in combination with cheaper, faster massively parallel DNA sequencing capabilities, have democratised multi-omic (genomic, transcriptomic, translatomic and epigenomic) data generation leading to a data deluge in bio-medicine. While some of these data-sets are trapped in inaccessible silos, the vast majority of these data-sets are stored in public data resources and controlled access data repositories, enabling their wider use (or misuse). Currently, most peer reviewed publications require the deposition of the data-set associated with a study under consideration in one of these public data repositories. However, clunky and difficult to use interfaces, subpar or incomplete annotation prevent discovering, searching and filtering of these multi-omic data and hinder their re-purposing in other use cases. In addition, the proliferation of multitude of different data repositories, with partially redundant storage of similar data are yet another obstacle to their continued usefulness. Similarly, interfaces where annotation is spread across multiple web pages, use of accession identifiers with ambiguous and multiple interpretations and lack of good curation make these data-sets difficult to use. We have produced SpiderSeqR, an R package, whose main features include the integration between NCBI GEO and SRA databases, enabling an integrated unified search of SRA and GEO data-sets and associated annotations, conversion between database accessions, as well as convenient filtering of results and saving past queries for future use. All of the above features aim to promote data reuse to facilitate making new discoveries and maximising the potential of existing data-sets.Availabilityhttps://github.com/ss-lab-cancerunit/SpiderSeqR

scholarly journals Rapid advancement in cancer genomic big data in the pursuit of precision oncology

2021 ◽  
Author(s):  
Tiara Bunga Mayang Permata ◽  
Sri Mutya Sekarutami ◽  
Endang Nuryadi ◽  
Angela Giselvania ◽  
Soehartati Gondhowiardjo
Keyword(s):  
Big Data ◽  
Open Access ◽  
Cancer Cell ◽  
Cancer Cell Line ◽  
Genomic Data ◽  
The Cancer Genome Atlas ◽  
Clinical Samples ◽  
Precision Oncology ◽  
Cancer Data ◽  
User Friendly

In the current big data era, massive genomic cancer data are available for open access from anywhere in the world. They are obtained from popular platforms, such as The Cancer Genome Atlas, which provides genetic information from clinical samples, and Cancer Cell Line Encyclopedia, which offers genomic data of cancer cell lines. For convenient analysis, user-friendly tools, such as the Tumor Immune Estimation Resource (TIMER), which can be used to analyze tumor-infiltrating immune cells comprehensively, are also emerging. In clinical practice, clinical sequencing has been recommended for patients with cancer in many countries. Despite its many challenges, it enables the application of precision medicine, especially in medical oncology. In this review, several efforts devoted to accomplishing precision oncology and applying big data for use in Indonesia are discussed. Utilizing open access genomic data in writing research articles is also described.

Sign in / Sign up

Export Citation Format

Share Document