Director Of Jingdong Search Department Talks About The Story Behind Double Eleven Calmly.

Here world

Xiaobian network to introduce to you is exclusive interview Jingdong director of search Department: Double eleven can deal with calmly behind.

11.11, it is also known as singles day. It seems that many users will turn their 'resentment' into consumption desire, and it seems that only the pleasure of consumption can satisfy the "lonely soul" of this special day.

But I do not know if you realize that there is no difference between Jingdong and usual browsing during this holiday season.

I guess not, after all, most people are immersed in the pleasure and satisfaction of shopping.

Looking back on the past few years, on similar days, the phenomenon of server downtime and page failure can occur frequently.

This phenomenon has not occurred this year, so it not only gives us a question, but what kind of equipment and architecture can support such a huge flow behind users' crazy browsing, search and order?

To this end, we specially interviewed Jingdong marketing research and development department retail platform architect and recommended search department director, they gave the following answer.

Marketing research and development retail platform responsible for content

For most users, the most important concern on double eleven is commodity trading. The most important part behind the paction is the dismantling and subsequent production, which is entirely responsible for Jingdong's marketing and R & D department's retail platform.

During the interview with Jiang Jiatao, a retail platform architect at Jingdong mall technology R & D system marketing research and development department, he introduced the responsibilities of the platform.

Jingdong mall technology R & D system marketing R & D department retail platform architect Jiang Jiatao

1. from the perspective of user order, users see the paction system after submission of orders at the front office website. The production process after the order is now responsible for the order system of the retail platform.

2. when the order is placed online, the order will be disassembled. For example, if an order is placed for multiple items, the order will be split into multiple sheets.

Follow up production (such as 211, 411, time limit distribution) order fulfillment time is also the system and the peripheral system to cooperate, responsible for the order production plan process.

3. when the bill is disassembled, the paper will be generated. At this point, the order will be generated. This part is related to the paction, and then will enter the process of the order production system.

Orders will be processed two times before the order is entered into the warehouse, such as providing invoice data, sheet data, user data, how to locate and how to send cars.

Only then will the relevant information be sent to the storeroom and the storehouse staff to produce.

4. when the list is actually produced in the storeroom, the front desk users want to see the return of order (packing, distribution information) information.

5. when the distribution is completed, users want to cancel or refund.

Besides, the panoramic monitoring of the production system can quickly locate the problems in the links and provide a good feedback to customer service and users.

From the order to the production and then to the final completion, the marketing research and development department's retail platform is mainly involved in the information pfer process of the dismantling and other parts besides production.

No need to face the user directly, the streaming assistant brother team.

Although this process does not seem to have important pactions, a large number of orders of eleven will double the pressure of the production system.

For Jingdong, splitting

It is a zero level system. Once the list can not be split, it means that production and distribution can not be completed, and the goods caused by controllable factors can not be delivered in time, which will make the user experience plummet.

In an interview with Jiang Jiatao, he learned: "this system is the same as the trading system, and has made new integration from hardware research and development, technology upgrading, team management and so on.

After 6.18, the system is reorganized and reorganized, and the processing level is increased to hundreds of millions of order processing capacity to achieve a distributed order processing system of this magnitude.

(about the optimization of the paction system part, see for the double one, do you know what Jingdong has done?)

In the past, the text data of Jingdong pactions, in the order process, the text is the original user's list, which has a lot of data to deal with.

Nowadays, the document processing system developed by Jingdong has been used in the Oracle database. However, with the growth of the single quantity, the ability of large text processing in the database is not very high. The GFS distributed file processing system developed by Jingdong is very capable of processing high concurrent small files. It is very suitable for the Jingdong application scene (although the quantity is relatively large, but most of them are small 10K files).

In addition, in the upgrading of database architecture, the database was pferred from the previous MySQL and Oracle libraries to the Oracle library.

The trading system introduced before is likened to a "sports car", but the production system does not need to be so fast. Production as a leading system can restrict the downstream system very well, speed limit and flood discharge, and help the brothers team to relieve the pressure.

Speaking of pactions and orders, many people will understand, but we have also neglected an important link - Search. Without search links, we can not see information such as recent browsing, buying before, and concerned commodities. Many people think that it is just a search, and it has little effect on double eleven, but in fact, it is not.

Recommended search department pressure

First of all, we need to know that Jingdong's recommended search department is responsible for the search engine and recommendation system of Jingdong platform, mobile platform and WeChat shopping platform.

At the same time, these platform search engines are responsible for developing the underlying search navigation and category navigation services by this department.

And with the advent of the mobile Internet era, the search volume of mobile terminals has been over PC, which is a challenge for search departments.

According to Jingdong mall technology research and development system recommended by Liu Shangkun, director of search Department: "double eleven traffic is relatively large, in order to be able to face calmly, this time mainly made expansion, interface degradation.

By increasing the server of search engine, we estimate and expand the capacity according to 6 times.

In the interview, I learned: "at present, double eleven is 6.18 times that. According to 6.18 times the amount of estimate, and considering the unstable factors such as attacks, it will estimate 6 times such an order of magnitude."

Jingdong mall technology R & D system recommends Liu Shangkun, director of search Department

Search engines can display inventories. If inventory is too slow, inventory will be downgraded.

In addition, if the search engine is attacked, there will be current limiting for iP and Cookie.

Current limiting is mainly for machine or malicious attacks to limit current. It sets a high threshold for individual iP, and the normal behavior of users can be let off.

The current limit is only opened when the search engine is abnormal and the network hardware is relatively high.

The reason why it is usually closed is also suitable for normal drill. When the network access is small, PC is used to copy some traffic to test the maximum throughput, and then to ensure normal use during the peak period through distributed index.

At the same time, in order to prevent network failures, Jingdong has made some adjustments, including multi computer room disaster recovery, multi machine room entry survival and cache adjustment.

Dual eleven is not only a test of performance and system, but also needs to be taken into account in the whole network and network architecture to ensure that search engines can survive in extreme cases.

According to Liu Shangkun, director of search Department of Jingdong mall technology R & D system, "even if the search engine services are all hung up, there will be a set of KV services that will carry out KV caching of all categories and keywords over 97%."

Two sides optimization of PC and mobile terminals

As mentioned above, in the mobile Internet era, the traffic brought by mobile terminals has not been underestimated. Therefore, the optimization of mobile terminals and PC terminals has become a top priority under the premise that the search engine can survive.

But mobile terminals have a natural disadvantage, that is, limited screen display, so Jingdong made some personalized adjustments, such as for the region will also do some personalized search, but double eleven period, personalized consumption performance is relatively high, and did not open.

It is revealed that this part will be put into use after double eleven.

PC also optimizes personalized search. For example, users who browse recently, purchase before, and pay attention to goods will have some adjustment based on user behavior and implementation preferences.

In the future, Jingdong will also consider adjustments based on social relations, such as data usage in WeChat's social relations chain (friends and friends' friends who have bought what will be tagged).

Although the mobile terminal calls the search backstage, there will be some tool intervention on the mobile terminal, and there will be some differences with the search results on the PC side, and the operators will have some processing on the mobile end sorting results.

The introduction of these personalized search is attributable to all users' search behavior and behavior data in the whole station will be made into long-term preferences and implementation preferences of users. The GMV generated per 1000 search and the conversion rate of search users will be judged by using the UV of search order divided by the UV value of search and the click rate of homepage.

At the same time, a series of clicks after searching will also affect subsequent product ordering, making click prediction and CTR and CBR prediction.

In addition, the ranking search engine is the same for the standard category (Jingdong self dominated products, the standard category has clear specifications, such as Samsung series notebook) and non-standard category (third party merchant goods, such as wallets, shoes and hats, gifts mainly based on open platform).

The same as the trading department.

Marketing research and development department's retail platform and recommendation search department's sole concern is still fear that the traffic volume is not enough.

And it can rely on 6.18 dimensions of software and hardware to prepare for the double eleven. It can be said that compared to last year, both in terms of system structure and winners, as well as the team, there has been a comprehensive upgrade.

So this time can not help but let us have a daydream, next year's double eleven, Jingdong will have what kind of upgrading and solutions to share for us, think there seems to be some small expectations.