The curtain fell on TiDB Hackathon 2020, but hacking never stops. After two days of fierce competition, TiDB Hackathon 2020 ended up with many star projects, such as UDF (a user-defined function framework based on WASM), TiGraph (a graph database on TiDB), and zh.md (an automatic language lint tool for Chinese documents). Developers have built a rich open-source ecosystem around TiDB and greatly improved TiDB’s performance.

To move things forward, PingCAP is now launching an 8-week TiDB Hacking Camp, an incubation program to actually land these projects in the community.

During the camp, each participating project will be paired with…


This article is based on a talk given by Xiao Huang at a TiDB User Group event.

Meituan is a world-leading online-to-offline (O2O) local life service platform, connecting more than 240 million consumers and five million local merchants through a comprehensive array of e-commerce services and products. To support our highly concurrent online services, we need a distributed database that can handle large volumes of data.

As more and more distributed databases enter the market, choosing the right one for our applications is not easy. After thoughtful consideration, we chose TiDB, a distributed, scale-out MySQL alternative database.

In this post, I’ll share the considerations we had in database selection and introduce how we use TiDB at Meituan…


Heng Long, Shuang Chen, Wenjun Huang

A graph database is a database that uses graph data structures to store and query data. Gartner believes that graph data stores can efficiently model, explore, and query data with complex interrelationships across data silos. Graph analytics will grow in the next few years. They also think it’s impossible to use SQL queries to analyze graph data in relational database management systems (RDBMSs).

But today, we want to say No!

Our TiGraph project implemented a new set of key-value encoding formats to add a graph mode to TiDB, a relational, distributed SQL database. TiGraph…


Industry: Automobile

Authors:

  • Xianqi Jin (DBA at Autohome)
  • Fan Zhang (R&D at Autohome)
  • Technical Architecture Team of Autohome Technical College

Autohome is the leading online destination for automobile consumers in China. It’s one of the most visited auto websites in the world. We provide professionally produced and user-generated content, a comprehensive automobile library, and extensive automobile listing information, covering the entire car purchase and ownership cycle.

The Autohome community forum is one of our oldest applications, with 100 million+ daily visits and 1 billion+ daily interface calls. As our data size rapidly grew, SQL Server became our database bottleneck. Sharding…


Author: Leitao Guo (Database and middleware manager at iQIYI)

Finding the right database solution for your application is not easy. At iQIYI, one of the largest online video sites in the world, we’re experienced in database selection across several fields: Online Transactional Processing (OLTP), Online Analytical Processing (OLAP), Hybrid Transaction/Analytical Processing (HTAP), SQL, and NoSQL.

Today, I’ll share with you:

  • What criteria to use for selecting a database
  • What databases we use at iQIYI
  • Some decision models to help you efficiently pick a database
  • Tips for choosing your database

I hope this post can help you easily find the right…


JD Cloud database team

In the past year, as most people practiced social distancing, they relied heavily on online services for shopping, remote working, and socializing. Online services surged, and as the requests and data flooded in, the database systems faced severe challenges.

After surveying hundreds of enterprises, we at JD Cloud developed a portrait of their ideal database:

  • It can dynamically allocate resources to meet the application’s requirements.
  • It supports ACID-compliant transactions and is MySQL-compatible.
  • It is highly available across data centers and automatically fails over without manual intervention.

To provide a cloud database service that meets these expectations…


Wenbo Zhang

(External) memory fragmentation is a long-standing Linux kernel programming issue. As the system runs, it assigns various tasks to memory pages. Over time, memory gets fragmented, and eventually, a busy system that is up for a long time may have only a few contiguous physical pages.

Because the Linux kernel supports virtual memory management, physical memory fragmentation is often not an issue. With page tables, unless large pages are used, physically scattered memory is still contiguous in the virtual address space.

However, it becomes very difficult to allocate contiguous physical memory from the kernel linear mapping area. For…


Cwen Yin, Calvin Weng

It’s been a year since Chaos Mesh was first open-sourced on GitHub. Chaos Mesh started out as a mere fault injection tool and is now heading towards the goal of building a chaos engineering ecology. Meanwhile, the Chaos Mesh community was also built from scratch and has helped Chaos Mesh join CNCF as a Sandbox project.

In this article, we will share with you how Chaos Mesh has grown and changed in the past year and also discuss its future goals and plans.

The project: thrive with a clear goal in mind

In this past year, Chaos Mesh has grown at an impressive speed with…


Max Liu

This article is based on a talk given by Max Liu at PingCAP Infra Meetup.

In my last post, I talked about how we made TiDB work, made it right, and, finally, made it fast. But we didn’t stop there. To build an ideal database, we need to make TiDB affordable for all and adopted by all.

Make it cheap

To tap into TiDB’s full potential, users must deploy it on SSDs. Some complained that SSD costs were high. …


Max Liu

This article is based on a talk given by Max Liu at PingCAP Infra Meetup.

TiDB is an open source, distributed SQL database started by PingCAP. As the CEO of PingCAP, I’m also TiDB’s principal product manager, with veto power on the important features of our product. Rather than adding more features, my duty at PingCAP is to cut down unnecessary features so that TiDB stays focused yet flexible.

In this post, I will talk about the philosophy behind TiDB’s evolution, and, as a product manager, how I figured out where TiDB would be going and how we…

PingCAP

PingCAP is the team behind TiDB, an open source MySQL compatible NewSQL HTAP database. Official website: https://pingcap.com/ GitHub: https://github.com/pingcap

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store