Chapter 768 Reptiles

There are many restrictions on doing business in the country. If it is a small company, as long as it operates and competes in a reasonable and legal manner, it will be fine. If it's a big company, it won't work.

If there is fierce competition between state-owned enterprises, the authorities will come forward to coordinate if they find that this competition has damaged the profits of both companies after statistics. It is possible to exchange the bosses of the two companies, turning hostility into friendship. If it doesn't work, the authorities will talk and ask for admonition. If it doesn't work, there will be a trump card, and the two companies will merge directly.

Competition among private enterprises is relatively free, but there are also restrictions among large companies.

It is not easy for every successful private enterprise to operate.

The authorities have certain protections in terms of laws, regulations and policies.

In the United States, once a company with a market value of more than US$100 billion reported financial fraud, it went bankrupt within three months and was dealt with extremely harshly. But it is different in China. It is really not easy for private enterprises to grow bigger. It is a pity that they will be killed directly because they make a small mistake. A fine of hundreds of thousands is a warning, which is very meaningful.

If the company collapses, what should we do with so many employees? What about the lost GDP?

This has led to many shameless and hateful businessmen, taking advantage of the country's care and love for the national economy, not doing business well, thinking about manipulating capital and harvesting leeks every day, resulting in a lot of fake and bad accounts for A shares.

The water here is too deep, and Zhou Buqi never participates in it. Even if the A-shares are now experiencing a historic surge, he will not speculate in stocks, so as not to cause a mess.

How much money can you make by speculating in stocks?

A person of his status, as long as the archway is upright, there is no need to steal chickens and dogs in the stock market, the government will take the initiative to give him money with drums and gongs.

If you want money to make money, the best way is to gather the money and give it to the most profitable, reliable and trustworthy person, and let him lead everyone to get rich together.

Zhou Buqi is basically such a person now.

Guo Dan has already given feedback, and the city has come up with a general opinion on the Ziweixing headquarters, and will give a support plan unprecedented for private enterprises in the capital area.

Going back to the competition between Ziweixing and Baidu, Zhou Buqi must not take some drastic actions as Shi Jinglin said.

Even if it is competition, it must be within a certain range.

If Ziweixing really kills Baidu, it's not awesome, it's stupid. Similarly, if Baidu killed Ziweixing, Boss Li would be invited to drink tea.

The 3Q war was once vigorous, and it was the authorities who came forward to resolve the dispute.

The next day, Zhou Buqi called Guo Pengfei, Han Leshui, Nie Caijun, Ning Yaxian and others to investigate the work at the search business group. The scene is not small.

Among the heads of Ziwei Star's major business groups, Wang Xiaozhou was under the greatest pressure.

The pre-engineering has been perfect, but the results are still not obtained, and the market share has been maintained between 33% and 35%. That's why he applied for a proposal to do a project similar to Baidu Tieba.

Fortunately, Zhou Buqi has full trust in Wang Xiaozhou.

"Don't worry, I have already said that in the short term, we don't look at the share, but only at the product."

"product……"

Wang Xiaozhou secretly sighed.

Looking at products alone, micro-point search is not as good as Baidu! The only advantage is that Micropoint has more supporting facilities, including a browser, a navigation network, an input method, a music platform, and so on.

Zhou Buqi smiled, "I don't have any confidence at all? Or do you admit that the technology is not good?"

Wang Xiaozhou has been a computer genius since he was a child. He has never convinced anyone in terms of technology. He shook his head and said: "The structure of the search engine is highly complex, including crawlers, renderers, DNS resolution, Redis memory databases, URL queues, seed queues, and response queues. , URL extraction, URL filtering, duplicate URL detection, etc., is a huge technical project. I think that Weidian’s architecture is not inferior to Baidu, but some technical details still need time.”

Zhou Buqi said with a smile: "I know that search technology is very high-end, but as time goes by, search technology will step down from the altar and become a more popular technology. The most fundamental technology is still big data processing."

In terms of the general direction, Boss Zhou is better than some professionals.

Wang Xiaozhou took it for granted, "Yes, the processing of big data. The gap between Baidu and Google, and the gap between Weidian and Baidu is mainly reflected in the efficiency of our data processing. Logically speaking, through crawler technology , can capture all the information on the Internet. But there is too much relevant information and the amount of data is too large. How to capture and display the desired information in a short time is the biggest technical problem for search engines.”

Zhou Buqi snapped his fingers and said with a smile: "Coincidentally, I came here this time just to ask you about reptiles."

Wang Xiaozhou was a little puzzled.

Boss Zhou is a technical layman, why does he care about technical details?

He slowly explained: "Crawlers are the basic tool for searching, and crawlers search for information... well, it's similar to using a browser to surf the Internet. They first send a request to the server, get the returned page, and then filter out valuable content. .If the time is long enough and the amount of calculation is large enough, using crawler tools, you can search all the information on the Internet.”

Boss Zhou seemed very interested.

Wang Xiaozhou took the pen and paper, and quickly wrote down a line of code, "If we want to crawl information on Weizhi.com, we can do it with this line of code."

Zhou Buqi took a look at the code, well, it is very simple.

headers = {'Use-Agent': 'ChaiknowsThebot', }

r = requests.gets("

html=r.text

print(html)

No wonder that in March, two college students from the Department of Computer Science at Beike were expelled.

This technique doesn't seem too difficult.

Because I was writing a thesis in my senior year, I could use search engines such as Google, Baidu, and Weidian, but I couldn’t find related papers written by others. what to do? There are students in the Department of Computer Science who wrote a crawler algorithm by themselves.

Then successfully crawled hundreds of related papers.

The next step is easy, excerpt, reorganization, and integration.

If the check is not enough, it is also simple, use Google Translate, first translate Chinese to English, and then translate English to Chinese. Then manually arrange the sentences smoothly, and the duplicate check will pass smoothly.

It may be that the entrepreneurial environment of Beike was brought up by Zhou Buqi, and the two college students had the idea of ​​making profits through technology, and they started the business of helping their classmates write papers.

When they were discovered, both were fired.

If Zhou Buqi hadn't come forward to protect them, handed over the illegal gains, and arranged to work on Xiaonei.com, they might have to go to jail, and their future would be completely ruined.

Wang Xiaozhou continued: "This is crawling of static websites. If it is a dynamic page like Youku and Friends.com, the algorithm will be relatively complicated. But no matter what, this is a very basic tool. We are a search engine, and the difficulty has already been solved. From complexity to scale."

Zhou Buqi frowned, "Old Ma... is the one from Ali. He told me to block Baidu's reptiles on Taobao, what's going on?"

Wang Xiaozhou said with a smile: "This matter is also simple. There is a crawling agreement between the crawler and the website. The crawlers in the list can crawl the content of the homepage. If Taobao wants to block Baidu, it only needs to add Baidu’s crawlers to the blacklist.”

"Um!"

Zhou Buqi nodded.

This is the answer he wanted.

Reptile blacklist!

Wang Xiaozhou seemed to see something, and tentatively said, "Boss, you... are you going to attack Baidu?"

Zhou Buqi said: "I looked at the data of Weizhi.com. In the past three months, there have been more than 110 million visits from Baidu."

Wang Xiaozhou was not surprised. He took a deep breath and said worriedly: "Weizhi's traffic is not high. If Baidu is blocked, the traffic will be even lower."

Zhou Buqi didn't care, "Weizhi doesn't need traffic, Weizhi needs high-quality content. As you said, Baidu's algorithm is not as good as Google's. It is difficult to complete the retrieval of some in-depth content through simple data processing to crawl Taking the content of Weizhi is a simple way. Many users access Weizhi through Baidu, we have to break this line!"

Wang Xiaozhou blinked, "Do you really want to block it?"

"certainly."

"But the Robot agreement has no legal effect."

"What?"

"This agreement is an industry constraint, a gentleman's agreement, not a legal provision. If Baidu really wants to crawl Weizhi's content, it can completely skip the agreement through technical means and forcibly crawl."

Zhou Buqi was thoughtful, "Gentlemen's agreement...if it is forcibly crawled, is it against business ethics?"

Wang Xiaozhou nodded, "It can be understood in this way."

Deeply disapproving in my heart.

Business ethics?

This thing is a layer of window paper, and it will break if you poke it.

"What if it is violated?"

"There have been similar cases in foreign countries. They violated the agreement and were punished. Because the judge believes that although this agreement is not a legal text, it should be followed as a widely accepted industry rule. But it seems that it is not so good in China. Just like RSS Like an aggregator, you can go to various websites to subscribe to information. If the website refuses RSS subscription, you can still force subscription through technical means.”

Zhou Buqi thought for a while, then said with a relaxed tone, with a smile: "It's okay, Baidu is listed in the United States, and I don't dare to go too far. Let's do this first, the first step, Weizhi.com blocks Baidu's crawlers. Your side also To prepare, I plan to completely cut off from Baidu step by step."

Wang Xiaozhou opened his eyes wide, "Cut all of them?"

Zhou Buqi said indifferently: "Yes!"

"Is this okay?"

"Who do you think will be more harmful if it is cut?"

"this……"

Wang Xiaozhou was a little hesitant, and it was hard to say.

Zhou Buqi said coldly: "Ziweixing doesn't take the initiative to bully others, but he won't allow others to bully. Baidu poached more than a dozen people from Xiaonei, and poached away a team full of establishments. Don't show your muscles. , Boss Li thinks I have a good temper and talkative!"

All blocked, of course, the most beneficial to the micro-point search.

But Wang Xiaochuan's structure is not so small, so he doesn't think it's a good idea. He kindly reminded, "Our own interests will also be damaged. Baidu is the largest search engine and a traffic distribution platform."

Zhou Buqi is very confident, "The advantage of the platform is that it is lightweight, and the disadvantage is that it is easy to get stuck. Lenovo computer brand is so famous, do you know what Lenovo is most afraid of? The most afraid of Microsoft's system authorization and Intel's chips. Every time there is a disagreement, a large sum of money has to be paid. If Baidu is compared to Lenovo Computer, Ziweixing needs to become the largest supplier of spare parts. Weizhi, Youyou.com, Xiaonei. There are today's headlines and Weibo. Compare them!"