Big Data in Everyday Life

I think many people do not have a complete concept of big data, and think that big data is very far away from us. In fact, big data is not far away from us, and big data is by our side. Life is closely related, so what is big data? In Baidu Encyclopedia, the definition of big data is as follows: Big data (big data) refers to a collection of data that cannot be captured, managed and processed by conventional software tools within a certain period of time. It requires a new processing model to have a stronger decision-making Massive, high-growth, and diverse information assets with capabilities, insights, and process optimization capabilities. First of all, it is certain that big data must be massive. In addition, the value of these data needs to be processed, sorted, analyzed, and tapped for its potential value. If it is just a bunch of massive data, it will be worthless , needs to be analyzed, sorted out, and made decisions, so that huge value can be generated. If we call massive data resources, analysis, sorting, and decision-making are called calculations, that is, resources + calculations have produced huge value. If there are no resources, we can talk about it. No more calculations. If there are only resources, it is worthless without calculations. In the rapidly developing modern society, we are surrounded by big data. Massive data is generated every second around the world, and it continues to be generated 24 hours a day. Next, we will give examples of what we can do around us. Let's see some big data! Daily traffic flow For example, in a city, there are so many cars and cars, and there are countless electronic monitoring equipment, which will generate a large amount of data every moment. These electronic monitoring equipment will continuously collect these Urban traffic data, each car's model, license plate number, geographic location, and passing time will not escape the eyes of these monitoring devices. The analysis of these data can get some valuable things, such as in which area traffic accidents occur frequently, further safety measures need to be taken, where violations of regulations occur frequently, and the reasons need to be further analyzed, etc. The subway station for commuting to and from work is in some metropolises. The subway is definitely a familiar thing for every office worker. Everyone has a deep understanding of the traffic flow of the subway. It is very fast and convenient to collect through a small bus card. To each subway station, the passenger flow of each time period, based on these passenger flow can also accurately calculate the usual peak period, and thus make the correct decision, such as at which time period, which station needs to carry out the flow of people Control to relieve the pressure of traffic travel. Daily reading data Now basically everyone has a smart phone, whether it is in a shopping mall, at home, or anywhere else, I believe that many people who bow their heads are constantly swiping their phones, and they are also reading their phones all the time generate massive amounts of data. Daily shopping data Various e-commerce websites and various items are generating massive amounts of data all the time. Since the advent of the Internet, the number of transactions per minute has increased compared with traditional businesses. by tens of thousands of times (much more than tens of thousands). Behind these various activities is the generation of massive data. As mentioned above, resources and computing are the core of big data. Only the combination of these two points can generate huge value. So what should be the specific processing flow of big data? What about the process? Why is it a process, because big data is no longer like the traditional small amount of data, which generates calculation results in real time. It is a process-oriented process, which is generally divided into the following links. Data collection/acquisition This is the first step. Data generation is caused by this link. This link is simply data collection, regardless of the repeatability and validity of the data. It is simple data entry. Data processing and format conversion The main work of this part is to process data, verify the validity and repeatability of data, and convert the format into a pre-designed format, so as to facilitate the transfer of data to fixed storage media. stored on. Data storage The storage medium mentioned above may be a database or a file storage system, or a combination of several storage methods, and the collected data is effectively processed and deposited. The statistical analysis of data analyzes the stored data in multiple dimensions and draws corresponding conclusions. These dimensions are jointly discussed and formulated by some technical personnel or business experts. According to these dimensions, many valuable results can be obtained ! Data Mining Through the analysis of the situation obtained from various dimensions, we can mine the various connections behind them, derive corresponding strategies, and implement them quickly.