

Big data challenges include capturing data, data storage, data analysis, search, sharing, transfer, visualization, querying, updating, information privacy and data source. Big Data technologies can be used for creating a staging area or landing zone for new data before identifying what data should be moved to the data warehouse. In addition, such integration of Big Data technologies and data warehouse helps an organization to offload infrequently accessed data.



The company can take data from any source and analyse it to find answers which will enable: 1.Cost Savings 2.Time Reductions 3.New Product Development 4.Understand the market conditions 5. Control online reputation Few Examples Of Big Data: A single Jet engine can generate 10+terabytes of data in 30 minutes of flight time. With many thousand flights per day, generation of data reaches up to many Petabytes. The statistic shows that 500+terabytes of new data get ingested into the databases of social media site Facebook, every day. Data is mainly generated in terms of photo and video uploads, message exchanges, putting comments etc. The New York Stock Exchange generates about one terabyte of new trade data per day.