14th March 2022 - Data has been transferred and dee2 is operational again. You will notice that we have https enabled. We confirm that the R package getDEE2 is also functioning properly. On the other hand, transfering analyses to Degust is not working and we will be addressing this next.
9th March 2022 - We now have control of the webserver and we are transferring data to a new 4TB volume. We estimate that DEE2 will be fully operational on Monday 14th March.
1st March 2022 - DEE2 was taken down by the cloud provider due to a cybersecurity issue. Apparently the server was found to be sending spam emails. DEE2 team will restore the service once allowed by cloud provider.
11th May 2021 - We have just completed a migration of DEE2 webserver from older Intel Xeon to a new AMD Epyc system.
3rd Oct 2020 - We have curated a number of human disease gene signatures that you can use in enrichment analysis. More information here: http://dee2.io/genesets.html.
1st May 2020 - Due to popular demand we have made available md5 checksums for the bulk data dumps. The file name is "checksums.md5". These will be updated with each addition of new datasets. Link: http://dee2.io/mx/
12th March 2020 at 11pm today we recorded 1000043 SRA run datasets uploaded to DEE2 servers. We're expecting the 1 millionth DEE2 dataset to become publicly available within the next 1-2 weeks.
9th January 2020 - Happy New Year! Here is a new blog post
describing recent updates and high priority issues for the next few months.
* Data processing - a work in progress
* Getting a new source of metadata - completed
Future areas for improvement
* The problem of studies missing runs
* Increasing queue efficiency
* Making the R package more efficient
* Website metadata search imptovements
* Call for compute resources
5th November 2019 - the webserver has had a few hiccups recently, but all is restored to normal operation. In the next few weeks we will be trying to complete the rest of the outstanding mouse and human datasets and then moving to a new source of metadata.
20th October 2019 - We suffered an unscheduled outage 16-18th Oct 2019 due to human error (sorry!) which was compounded by hardware issues on the Nectar cloud. All seems to be working now.
19th June 2019 - The June 2019 update to DEE2 has new datasets, new features and new challenges. Highlights include new integration with Degust and iDEP and >200k new runs added for human and mouse. SRAdbV2 is now permanently dead, so DEE2 wil not be adding any new SRA runs until an alternative is found. For the complete story, read on here.
8th April 2019 - Very proud to have DEE2 published in Gigascience. Thanks to everyone who has contributed, including reviewers who made several important suggestions. Link here.
11th January 2019 - In response to feedback we are unveiling several new features:
28th November 2018 - DEE2 was presented at the ABACBS2018 conference in Melbourne. See the Poster.
28th November 2018 - A guide to loading in bulk dumps had been added to my Blog.
12th November 2018 - Ever wondered how accurate DEE2 data actially is? Well we have just undertaken a simulation study and comparison to GEO deposited data to demonstrate the quality of DEE2 data. More details here.
26th October 2018 - Recently there have been many projects with ≥500 SRA runs, meaning that they have not been readily available from the webserver as one file. In order to address this, I've packaged these SRA projects with ≥200 SRA run numbers into zip files. Only projects with EVERY run processed successfully by DEE2 are included. These are now available here.
7th October 2018 - QC information is now linked in the search results and available by hovering the mouse over the QC link. Note that all the datasets are currently classified as "PASS" but this will be chenging soon. Also we moved to another nectar server with storage so there have been some updates to webserver cgi scripts. Also the keyword search is now case insensitive.
22nd September 2018 - the bulk data dumps are now available via http. Dat turned out to be too slow and unreliable for files of this size.
21st September 2018 - Several small bits of news. Firstly a new domain name server that is working much better than the last one. Still unable to get https working so this will not likely happen while using Nectar servers. Secondly the domain name sever change broke the docker image so it was modified and rebuilt. Thirdly the data processing is progressing steadily with the torrent of new datasets that became visible upon integration with the newest SRAdbV2. Lastly, the R interface hs undergone several improvements and should be more robust now. The new documentation has been added (link).
14th March 2018 - search functionality has been restored, so feel free to test it out.
1st March 2018 - Hope you like the new mobile friendly webpage
31st January 2018 - DEE2 data pipeline is finalised and processing is underway. For more information, see the recent blog post.
18th October 2017 - As of a month ago, the original DEE site has been down and we've been working towards DEE version 2, which will be hosted by Monash Uni. This app is still under construction, but stay tuned for the official release at the end of 2017.
15th December 2016 - Our lab is moving to Monash Central Clinical School. Stay tuned for a revamped DEE in 2017 with new data and features. This URL could go dead anytime next year so please finalise your work.
13th August 2016 - Looking for Illumina bodymap2 count data? Try searching ERP000546 for human.
13th August 2016 - Bulk data dumps are back online. An issue with the count matrix headers was resolved.
12th August 2016 - Due to an issue with the bulk data dumps, these have been taken down until the problem is resolved. We apologize for the inconvenience.
14th July 2016 - Our analysis servers are undergoing upgrades and the July database update will be delayed by approx 2 weeks.
19th Jan 2016 - More quality control measures are being added to DEE. This will enable users to view basic QC info such as base qualities, number of reads, proportion uniquely mapped, etc. before downloading. These data will be provided to users in parallel with the expression count matrices. Enhanced QC data are already available for E coli, C elegans and A thaliana, but are in progress for other species.
8th Jan 2016 - Ever searched for datasets and got the error "Too many results found"? We've modified the interface to display all search results when over the >500 datasets limit. This should allow users to select accession numbers of interest.
8th Jan 2016 - A bug in the R function has been resolved. If you had trouble with it before, give it another try and let us know if you encounter any issues getting your data into R.
31st Dec 2015 - The latest update run is underway and looking to add about 37k human and 17k mouse datasets. We have all available servers on the job :)
23rd Dec 2015 - We've performed an upgrade to SRAdb integration to release some further datasets that were previously missing. Thanks for your support in 2015 and making it such a successful year. Thanks to your fedback, we're looking forward to a bunch of new features in 2016. Happy holidays, Merry Christmas and a happy/successful year to you all!
20th Oct 2015 - Public announcement of DEE see my blog post.
24th Sept 2015 - As of yesterday our site is public, but still in the testing phase.
26th Aug 2015 - Bulk and query data are now available in .zip format to improve access for windows and mac users.
24th Aug 2015 - Updates to the datasets are now made weekly based on SRAdb entries.
5th Aug 2015 - Metadata formatting has been streamlined with SRAdb integration.
17th Jul 2015 - More data from human, mouse, Arabidopsis, fruitfly and worm have been added.
9th Feb 2015 - The website is under construction.