Chapter 541 Hadoop

After hearing Xu Liangjie's words, Zhou Buqi called Cheng Binghao, the chief technology officer, and communicated in detail about the search.

Sina's Aiwen search was created by his team.

If he hadn't left Sina last year, he might have been promoted to Sina's CTO with this credit.

However, he is now the CTO of Ziwei Star, and he is not bad at all.

Cheng Binghao's views are similar to Xu Liangjie's, and more localized.

"Why does Baidu make content? Because doing search in China, making content is the only way to survive."

Cheng Binghao's views are sharper and more direct.

Doing searches in China is different from Silicon Valley. According to laws and regulations, some content must be removed and blocked. And consider the user intimately, and help users remove some in-depth professional content through some in-depth algorithms.

Because the more professional, the less popular, and the more vulgar, the more popular.

If you want to get the most popular users, you should not provide too professional content, but provide some easy-to-understand and not-so-complicated search results.

For example, Baidu is already doing machine learning, which is the earliest artificial intelligence. That is, let the machine learn through the user's search results and feedback on the search results. In this way, when searching in the future, let the machine help recommend the optimal solution that is more in line with the taste of the public.

This has another benefit, which can further narrow the search scope.

Baidu's search technology is not as good as Google's, the gap is huge...far beyond imagination. In fact, it is not only Baidu, but also Yahoo and Microsoft.

Google can search out relevant content in the massive Internet data in the shortest time, and then arrange it according to the algorithm, and present it in front of the user's computer.

But other search engines can't.

What should I do if I want to provide users with the fastest response speed?

The easiest way is to narrow down the search target.

Google retrieves 1 billion pieces of information, and Baidu retrieves 100 million pieces of information.

There are fewer sources of information, and it is not surprising that the answers you want cannot be found.

Therefore, if Baidu wants to secure the number one position in China, it must, can only, and must do content. Through self-produced content, to make up for the weakness of retrieval technology.

This method cannot meet the needs of high-end users, but it can meet the needs of 80% of users in the whole society, which is enough.

It can be said that Mr. Li of Baidu completed the challenge to Google's hegemony in the search field by retreating from the front and guerrilla from behind, and succeeded. From this point alone, it is much better than giants such as Microsoft and Yahoo. Those people are still struggling to play technology with Google.

Just kidding, it's not in the same order of magnitude at all.

In the field of big data processing, global technology companies rely on an open source core architecture called Hadoop. The source of this architecture is Google's disclosure of its own algorithm theory, but did not disclose the details of the algorithm. So Yahoo and Apache took the lead in cooperation, convened a large number of top scientists, and made this big data processing system based on Google's algorithm theory.

But there are many problems, and there is a gap of several times from some key indicators announced by Google. There is no way to solve them, so I can only grit my teeth and accept them. Giants including Microsoft, Amazon, Ali, Huawei, Facebook, Yahoo, Baidu, etc. all use this open source system.

Only Google doesn't.

Not only did they not use it, but they also completed the system update in 2010...overthrowing the original theory and launching a more advanced and high-end big data management system.

That is to say, the underlying architecture of the big data management system used by technology giants around the world is several times behind in efficiency compared to the old version eliminated by Google.

Of course the giants are also fighting, wanting to make something beyond Hadoop.

The domestic representative is Baidu.

In 2007, Baidu's stock price soared all the way, up and down. Li Yanhong decided to represent Huaxia and make a world-class pioneering project, named "Pyramid Project".

The most elite core technicians from Baidu were recruited, and a team of experts was recruited from the outside. The leader is Yang Zhenkun, the current head of Ziweixing R\u0026D Center!

This big project does not use JAVA, Python, or even C++, and writes code directly in C language.

It can be described as ambitious.

At that time, Baidu was full of passion from the highest level to the first-line developers. After all, this was a major event to challenge Silicon Valley, and it was done enough to raise the prestige of our country.

The project team worked overtime crazily, and the lights on the west side of the 12th floor of Baidu Building were on every night.

After two years of work, the project was a success!

However, in the end Baidu returned to the Hadoop camp.

Why?

Because there is a small project team that simply packaged the Hadoop code, rewrote the API, and compared the performance with Baidu’s pyramid system that took two years and invested a lot of money to build.

As a result, the small project team won by a narrow margin!

Seeing this result, Li Yanhong was immediately disheartened, as if a basin of cold water had been poured on her.

Hadoop is an open source project, which is updated and promoted by developers all over the world, and has great potential. If the original one doesn't have a huge advantage, coupled with workplace politics, it can only go in the direction of open source...

In the early days of Alibaba Cloud, it encountered great difficulties and was deeply questioned by the industry. Because at the very beginning, Dr. Wang Jian made a wrong judgment, and wanted to build a big data system similar to Hadoop, half copied and half revised, but it was still confused. Later, seeing the success of Amazon Cloud, it suddenly dawned on me, and I quickly turned around and changed the direction, which was the success.

Technology companies such as Penguin, Shanda, Sina, Huawei, and Kingsoft saw Ali wading through landmines in front of them, and they really made their way out. At this time, everyone stopped talking about "old wine in new bottles" and "the Avatar era was born". They quickly followed up and made their own cloud computing platform smoothly.

Behind this is the open source project Hadoop.

Cheng Binghao said: "When I was in Sina, I realized the importance of content, and began to search for supplementary sources of content on iAsk, such as iAsk Knowledge People, a year earlier than Baidu. However, the support from the company was limited. When searching, I was the only one in the entire search department. Last year, there were only more than 120 people in the team, not to mention comparing with Baidu, even Sogou.”

Zhou Buqi asked: "If you want to make content, what else do you think needs to be done?"

"Basic content."

"Which aspect?"

"For example, search, how to make fried rice with eggs? If you use Google, you will find a lot of long articles, some experience of many experienced chefs, etc. These are of course very good, but users may not need them. They only need one result, whether to fry rice first or Scrambled eggs? Baidu Zhizhi made a good supplement.”

Zhou Buqi nodded, "Indeed, a simple search is more in line with the public's taste."

Cheng Binghao said: "We have the advantage of being a latecomer. Just watch how Baidu does and what it does, and learn it. If you learn a lot, you can beat Google and become the second in China. If you do better , the effect of channel efforts is more prominent, and it is not impossible to surpass Baidu."

Zhou Buqi laughed and said, "You are really confident!"

Cheng Binghao said very seriously: "If the search business is entrusted to me, I promise to beat Baidu within five years!"

Zhou Buqi laughed out loud again, and perfunctorily passed it.

For the search business, he must be more inclined to Wang Xiaozhou.

Experienced in previous lives.

Sina's Aiwen search has not done anything well, and it is worse than NetEase's Youdao search. The best one is Sogou, which has secured its second place in the market.

Through many conversations, Zhou Buqi had a preliminary understanding of the search business.

Both Xu Liangjie and Cheng Binghao are experts in the search field, and both have developed search engines with relatively large influence. Although all failed, but the experience is valuable.

If Wang Xiaochuan is brought in again, Ziweixing will form a "troika" of the search business.

With this configuration, you can always try to break your wrist with Baidu, right?

Think about it, really a little excited!

Among the three giants of BAT, Ziwei Xing was going to face the first opponent.

At this time, Zhou Buqi received an urgent call.

It was Wen Zhixia calling.

"Honey, come here."

"Now?"

Zhou Buqi was a little surprised.

Wen Zhixia squeaked and said, "I just mopped the floor in the office, and I was wearing high heels again, so I accidentally fell down..."

"Damn it!" Zhou Buqi was taken aback, very nervous, "How is it? Are you okay? Baoda, it must be Baoda! The child is gone, we will be born again in the future, you are the most important!"

Wen Zhixia was angry and funny, "What are you talking about? You've only been pregnant for more than two months, and the child hasn't formed yet, and you're still keeping the big and the young. You're going to be a father, and you're still messing around like this?"

This tone is slightly coquettish.

From the looks of it, she's fine.

That's right, I was only two months pregnant, and if I accidentally fell, it's usually not a big problem. Unless it is a woman who does not care about her body and has had too many abortions, or some gynecological diseases.

Teacher Wen definitely doesn't have these problems.

"Are you okay?" Zhou Buqi breathed a sigh of relief.

"It's okay." Wen Zhixia sighed slightly.

"What's the matter?"

"Uncle is angry, and he will give me a vacation no matter what."

"Well……"

Zhou Buqi collapsed a little bit, a little speechless.

Last time at the Langping factory, Zhou Buqi did his father a big favor. Reciprocating, Zhou Buqi asked his father for instructions, saying that he wanted Mr. Wen to go back to work at the milk tea factory.

I'm pregnant in October, so I can't be bored at home all the time, can I?

Teacher Wen is not the kind of housewife. She is a career woman with her own career pursuit.

It's easy to say, Dad agreed.

Unexpectedly, such a thing happened!

Now it's in big trouble.

Teacher Wen fell down in the office, just this scene, the elders have to worry about it for several months. It is impossible to work in a milk tea factory any more.

Wen Zhixia said sullenly, "Uncle told you to pick me up, go to the hospital, and then... Then I won't be allowed to go to work."

"It's okay, I'm here! I'll go there right now, you wait! Well, are you really okay?"

"I'm sure it's all right. I paid attention too. The moment I fell, I put my arm on the ground. I didn't even fall down on my butt, but my arm twisted."

"Okay, then you wait for me."