Differences

This shows you the differences between two versions of the page.

--- commandline_remote_blast [2012/10/31 06:10]
annytod
+++ commandline_remote_blast [2015/04/14 16:30] (current)
sebastien.renaut
@@ Line 1: / Line 1: @@
-====== Anti Ageing exposed Skin Care Tips: Recharge Your Skin ======
+====Sequence similarity search remotely by batch, on the online public NCBI databases====
+===When batch blast is useful===
+Comparing many sequences (queries) at a time to the NCBI public databases saves time compared to performing repeated searches for each different queries, and has the advantage of comparing to the most up to date version of the public databases. It is unfortunately not possible to perform this task directly from the online access of the various BLAST programs offered on the [[http://blast.ncbi.nlm.nih.gov/Blast.cgi|BLAST NCBI website]]. The commandline programs written by the NCBI team must be run from the terminal to complete this type of batch similarity search, and the main commands and steps are detailed here.
+===Batch blast at the QCBS===
+As part of a collaborative project undertaken by a team of [[http://qcbs.ca/research/working-groups/working-group-1/|QCBS researchers]], we aimed at isolating from the NCBI databases the orthologs of 29 different genes in 94 different species where the genome or transcriptome is partially sequences. We would soon realized that performing these searches, and downloading the best hits cannot not quickly done by multiple copying and pasting.  The steps described below were done on Mac OS X 10.6.8, in summer 2012.
+==Downloading and installing the BLAST program==
+BLAST+, the new version of the BLAST programs written by NCBI with improved performance and speed now allows batch blast to be performed from your computer to the online NCBI databases. It is available for download on this [[ftp://ftp.ncbi.nlm.nih.gov/blast/executables/blast+/LATEST/|NCBI ftp page]]. At the time, ncbi-blast-2.2.26+-universal-macosx.tar.gz was downloaded, but it is frequently updated
+As explained in the BLAST+ installation instructions pages ([[http://www.ncbi.nlm.nih.gov/books/NBK52640/|UNIX and MAC]] or [[http://www.ncbi.nlm.nih.gov/books/NBK52637/|Windows PC]]), to unzip and install the program file, open the terminal, change directory until you are in the same location as the zipped file, and type the command (on a Mac):
+<code>
+tar xvpf ncbi-blast-2.2.26+-universal-macosx.tar.gz
+</code>
+The program is now installed on your computer.
+==Run the sequence similarity search==
+To run one of the BLAST programs (blastp, blastn, blastx…), change directory to where the BLAST+ program is located. For instance, /Applications/ncbi-blast-2.2.26+/bin.
+To know the command that will be useful for your search, read the [[http://www.ncbi.nlm.nih.gov/books/NBK1762/|LAST+ user manual]], the [[http://www.ncbi.nlm.nih.gov/books/NBK1763/|commanline manual]], and consult the help menu for the program you want to use. To know more on the meaning of output statistics, read this [[http://www.ncbi.nlm.nih.gov/BLAST/tutorial/Altschul-1.html|NCBI tutorial]] For instance:
+<code>
+./blastp –help
+</code>
+Read carefully all the options, and launch the command! For instance, if the objective is to find, among the set of amino acid sequence from //Aspergillus fumigatus// in the non-redundant (nr) database, those that are similar to a set of 32 different //Schizosaccharomyces pombe// proteins that you have saved in fasta format txt file, the command typed may be:
+<code>
+./blastp -evalue 1e-20 -max_target_seqs 1 -db nr -query /Users/yourusernam/Documents/Folder1/Folder1_1/Folder1_1_1/Schizosaccharomyces_pombe.fasta -entrez_query "Aspergillus fumigatus[Organism]" -out /Users/yourusernam/Documents/Folder1/Folder1_1/Folder1_1_1/Aspergillus_fumigatus_blast.output.txt -remote
+</code>
+If the desired output has to have only the query name, the sequence database name, the e-value, and the number of identical sites, the following options can be added at the end of the command:
+<code>
+-outfmt '6 qseqid sseqid evalue nident'
+</code>
+All this into one command:
+<code>
+./blastp -evalue 1e-20 -max_target_seqs 1 -db nr -query /Users/yourusernam/Documents/Folder1/Folder1_1/Folder1_1_1/Schizosaccharomyces_pombe.fasta -entrez_query "Aspergillus fumigatus[Organism]" -out /Users/yourusernam/Documents/Folder1/Folder1_1/Folder1_1_1/Aspergillus_fumigatus_blast.output.txt -remote -outfmt '6 qseqid sseqid evalue nident'
+</code>
+Here, we needed to extract only the gi number, that would be used to retreieve the sequence from [[http://www.ncbi.nlm.nih.gov/sites/batchentrez|NCBI Batch Entrez]]. The following command extracts the second field (-f 2), where the fields are delimited by the sign "|" (-d "|"), to a new txt file entitled Aspergillus_fumigatus_blast.output.list.onlygi.txt .
+<code>
+cut -f 2 -d "|" Aspergillus_fumigatus_blast.output.txt > ../onlygi/Aspergillus_fumigatus_blast.output.list.onlygi.txt
+</code>
+==Another useful command==
+Saving comma or tab separated values files from the MAC OS 10.6.8 often introduced end of line characters (^M) problematic for manipulating txt files. Applying the following command can delete the ^M characters, and make the file readable for most programs.
+<code>
+tr '\r' '\n' < filename.txt > filename_nolineend.txt
+</code>
+===Conclusion===
+These steps allow the retrieval of the sequences of the best hit to a large number of initial sequences.
-Bad natural skin care ingredients abound in this era. It isn't ample that we have to cope with pollution, processed foods and chemically-filled water, we also have to look out regarding [[http://acneskincarehub.com/|exposed skin care review]] ingredients in your anti aging merchandise.By teaching yourself on what these kind of bad natual skin care ingredients are usually, you can prevent them and find the most effective natural, chemical-free ointments available. This will likely not only gain your skin greatly now, nevertheless it will also decide how you look down the road.I have dealt with sensitive skin color during my entire life and could by no means tolerate substances and specific ingredients well. When I started out using skincare products during my late adolescents I couldn't understand why my pores and skin was smashing out, as these companies ended up claiming to own all-natural products.Once i did more research I discovered the truth. Almost all skin lotions contained Three or more bad skincare ingredients. These are:1. The parable group are good additives but they have been proven to cause hypersensitive reactions, skin problems and issue with your inside bodily techniques. I know they are not effective well with my skin, so you need to avoid them if you'd like healthy and delightful skin later on.2. Perfumes do smell nice, but they also overcome your body and cause allergies with time. The word fragrance may refer to more than 4,1000 separate elements, which they have been proven to get toxic or even carcinogenic. Aromas affect your current nervous system, triggering mental troubles, such as depression, hyperactivity along with irritation.
-{{http://www.expertacnetreatment.com/wp-content/uploads/2012/02/exposed-before-after.jpg|}}