BitTorious: global controlled genomics data publication, research and archiving via BitTorrent extensions

BMC Bioinformatics

Valentin Dinu¹  Preston V Lee¹ 

[1]Department of Biomedical Informatics, Arizona State University, 13212 East Shea Boulevard, Scottsdale 85259, AZ, USA

关键词: Bittorrent;    Open source;    Software;    Big data;    Bioinformatics;    Data transfer;    Networking;   

Others  :  1084269
DOI  :  10.1186/s12859-014-0424-9

 received in 2014-10-07, accepted in 2014-12-11,  发布年份 2014

【 摘 要 】

Background

Centralized silos of genomic data are architecturally easier to initially design, develop and deploy than distributed models. However, as interoperability pains in EHR/EMR, HIE and other collaboration-centric life sciences domains have taught us, the core challenge of networking genomics systems is not in the construction of individual silos, but the interoperability of those deployments in a manner embracing the heterogeneous needs, terms and infrastructure of collaborating parties. This article demonstrates the adaptation of BitTorrent to private collaboration networks in an authenticated, authorized and encrypted manner while retaining the same characteristics of standard BitTorrent.

Results

The BitTorious portal was sucessfully used to manage many concurrent domestic Bittorrent clients across the United States: exchanging genomics data payloads in excess of 500GiB using the uTorrent client software on Linux, OSX and Windows platforms. Individual nodes were sporadically interrupted to verify the resilience of the system to outages of a single client node as well as recovery of nodes resuming operation on intermittent Internet connections.

Conclusions

The authorization-based extension of Bittorrent and accompanying BitTorious reference tracker and user management web portal provide a free, standards-based, general purpose and extensible data distribution system for large ‘omics collaborations.

【 授权许可】

   
2014 Lee and Dinu; licensee BioMed Central.

【 图 表 】

Figure 1.

Figure 2.

【 参考文献 】

• [1]Brooks FP Jr: No silver bullet essence and accidents of software engineering.Computer 1987, 20(4): 10-19. doi:10.1109/MC.1987.1663532.
• [2]Stein LD: The case for cloud computing in genome informatics. Genome Biol [NLM - MEDLINE] 2010, 11(5):207. BioMed Central Full Text
• [3]Langille MGI, Eisen JA: BioTorrents: A File Sharing Service for Scientific Data.PLoS ONE, 5(4), e10071. doi:10.1371/journal.pone.0010071.
• [4]Norberg A: BEP-0036: Torrent RSS Feeds. Downloaded October 3, 2014 from http://www.bittorrent.org/beps/bep_0036.html; 2012.
• [5]Harrison D. BEP-0027: Private Torrents. Downloaded October 3, 2014 from http://www.bittorrent.org/beps/bep_0027.html; 2008.
• [6]World Community Grid: Global Statistics. Downloaded October 3, 2014 from http://www.worldcommunitygrid.org/stat/viewGlobal.do; 2014
• [7]Costa F, Silva L, Fedak G, Kelley I: Optimizing data distribution in desktop grid platforms. Parallel Processing Letters 2008, 18(03):391-410.
• [8]Elwaer A, Taylor I, Rana O: Optimizing Data Distribution in Volunteer Computing Systems using Resources of Participants.Scalable Computing: Practice and Experience, 12(2). doi:10.12694/scpe.v12i2.714; 2011.
• [9]Haussler D, Patterson DA, Diekhans M, Fox A: A Million Cancer Genome Warehouse. EECS Department, University of California: Berkeley; 2012.