To practice examples mentioned in "Hadoop: The Definitive Guide" book by Tom White , http://www.amazon.com/Hadoop-Definitive-Guide-Tom-White/dp/1449311520 we need weather dataset from NCDC. The link https://www.ncdc.noaa.gov/ mentioned in the Tom White book doesn't easily provide the link to download weather dataset.
I had to spend lot of time looking for these datasets. Now I am here providing you with steps to download the weather dataset.
1. Datasets are available for download on this FTP link. Data is partitioned by year starting from 1901 to till date.
2. We can directly download these datasets on Unix machines. Command to do that,
wget ftp://ftp.ncdc.noaa.gov:21/pub/data/noaa/2017/007026-99999-2017.gz
This command downloads 007026-99999-2017.gz file for the year 2017 onto your current working directory.
Hope this helps.
Thank you! This wasn't easy to find.
ReplyDeleteWas really trying hard to get hands on this data. Thank you so much.
ReplyDelete