big-data-Application

《big-data-Application》由会员分享，可在线阅读，更多相关《big-data-Application（7页珍藏版）》请在装配图网上搜索。

1、Application of big dataAbstract: Since the mid 1980s, the world has experienced an unprecedented explosion in the capacity to produce, store, and communicate data, primarily in digital formats. Simultaneously, access to computing technologies in the form of the personal PC, smartphone, and other han

2、dheld devices has mirrored this growth. With these enhanced capabilities of data storage and rapid computation as well as real-time delivery of information via the internet, the average daily consumption of data by an individual has grown exponentially. Key Words:Big data; education; application;Uni

3、verse Discovery:Use Big data to analyze huge amount of data stored in the Glass plates in the traditional way and provide us a better picture of the origin and evolvement of the universeEnvironmental researches:An Irish company called Tree Metrics with eleven million trees indexed on three continent

4、s develops a system using big data to keep track of all the trees in order to meet the log market demand while at the same time minimizing the effect on the forest.Education Support:Big data technology is also used as an assistance of computer algorithm to transform large amount of books simultaneou

5、sly into native languages to better the education in underdeveloped regions.Energy Saving :Big data can help power companies and their customers conserve energy by giving feedback message推荐精选s from a malfunctioning meter to the power company or alarming customers when they are wasting energy.Crime P

6、redictionBig Data analytics is helping police departments to develop prediction algorithms to prevent probable crime commitments.TechnologyHadoop EcosystemVolume: large amount of dataVariety: heterogeneity of data types, representation, and semantic interpretation.Velocity: both the rate at which da

7、ta arrive and the time in which it must be acted upon.Veracity: refers to the biases, noise and abnormality in data. Is the data that is being stored, and mined meaningful to the problem being analyzed.( In scoping out your big data strategy you need to have your team and partners work to help keep

8、your data clean and processes to keep dirty data from accumulating in your systems.)Challenges:Privacy:Big Data profoundly changes the problem of privacy another reason why the USs data-driven companies are lobbying so hard to use the review of data protection law to weaken it.A big data society see

9、ms to be inevitable, andpromises much, but privacy (properly understood) must be an important part of any such society.推荐精选First, we need to think broadly about privacy as more than just the keeping of a secret，but as the rules that must govern personal information.Second, we need to realize that in

10、formation does not lose legal protection just because it is held by another person.Confidentiality rules will be essential in any big data future.Third，we need to develop somebig data ethicsas a society.Big data in the field of Education:v Students using online systemv System to collect and record t

11、he studentsonline learning behavior ,saving into databasev For data analysis and processing, predicting the students academic performancev The result of the forecast and feedback for visual processing v To meet the requirements of the students individual learning materialsv Teachers,administrators,

12、and developers timely to give students guidance and helpBig data has changed the way financial institutions operate in traditional data from four different ways， achieving great business value。These four areas（4C） include：Compatibility，Connectedness，Cost，Capitalization. The application of large data

13、 in financial industry is gradually expanding , Overseas, big data have been fully tried in the financial industry, such as risk control, operation management, sales support and business model innovation. In China, the application of large data in financial institutions is still basically at the ini

14、tial stage. Key challenges such as data consolidation and departmental coordination remain the main bottlenecks that hinder financial institutions from translating data into value. Example:An online store has an existing SQL Database that manages its authorization system and storefront. SQL is neces

15、sary in order to ensure no lost transactions and full ACID compliance.The store also tracks its social activity using a KEY/Value database. This database provides speed and can easily store large amounts of data but provides less consistency than a SQL solution. However, as social data is not as cri

16、tical as transactional, this solution is appropriate.The store also provides recommendations to customers about products they might like. They use a Column database for this purpose. SQL is not necessary because the information is not relational. The Ministry of Education is responsible for managing

17、 data about students around the province. They have over 125 million records (students), 241 million rows and over 15 years worth of data. The data is stored using 450 tables, but the only variety is at attribute level(i.e. Standardized testing,performance,etc). They receive the data from individual

18、 schools in giant chunks four times a year.推荐精选The Ministry decided against using big data tools to manage their data and is still using a RDBMS. Although they hava large amounts of data, the type of their data and the velocity at which they receive it means that a RDBMS is still best. They also hav

19、e compliance and privacy issues that make NoSQL an unsuitable choice.Each school and school board was sending the data to the Ministry using different schemas and this inconsistency made data management difficult and decreased the value of the data for BI purposes.The Ministry took a master data man

20、agement approach. Over the course of 4 years, they created common methodologies and a data usage framework that ensured the data they were sent and the data they used for reports and presentations was the same.Social processesOther Internal FactorsOther External FactorsInformation system(Databases)D

21、ecisions/Courses Of ActionReflection and EvaluationDecision Process推荐精选References1JJ Berman - Principles of Big Data Copyright Principles of Big Data 20132K Krishnan - Data Warehousing in the Age of Big Data 20133C Lynch - Nature How do you data grow? 20154W Qin, Y Shi, Y Suo - Tsinghua Science & Technology Ontology-Based Context Aware for Smart Spaces 20085 W He，J Shen，X Tian，-Industrial Management & Data Systems Gaining competitive intelligence from social media data 2016 （注：可编辑下载，若有不当之处，请指正，谢谢!） 推荐精选