Overview

Welcome to IJCAI 2020 Mahjong AI Competition. In this competition, your task is to develop an intelligent Mahjong agent that is able to compete with other agents as well as human players on the online AI platform, Botzone. We adopt Mahjong Competition Rules (MCR) in this challenge. We provide a sample program for Mahjong beginers. You are also provided with our judge program which can help you learn the rules of MCR and debug your AI. The final winner after two formal rounds will be the champion of the competition.

Mahjong is a four-player imperfect information game that originated in China with a long history of more than 3000 years. In 1998 the All-China Sports Federation founded a universal competition standard called Mahjong Competition Rules (Guóbiāo Májiàng in Chinese pronunciation, literally Chinese Standard Mahjong), which we adopt in this competition. Mahjong involves strategy and a certain degree of luck, and the uncertainty brings to the game a lot of fun and challenge. Different from Mahjong’s varieties in Asia, e.g., Riichi Mahjong (Japan), Chinese Standard Mahjong encourages the players to adopt aggressive strategies, which makes the competition more watchable and attractive.

To write an expert-level bot, the participants may require analyzing the combinations of winning tiles that have different folds to get enough point hands, calculating the distance between current hand tiles and the final winning tiles to decide which tiles should be discarded. In order to successfully solve this challenge, participants can benefit from combining different areas of AI such as planning, game theory, heuristic search, MCTS, opponent modelling, and machine learning. Successfully integrating methods from these areas is one of the great challenges of AI.

Pesudo Code of Contest System in Tournament Round

Registration

  • Competition Registration
  • Conference Registration
    • The participants who advance to the finals will need to register for IJCAI-PRICAI 2020.
    • Each person can be a member of at most one team.
  • Click here to view the competition group page.

Get Started

Want to be stronger?

  • Learn Mahjong Competition Rules from our wiki
  • Download our judge program and Mahjong Helper to learn MCR in details
  • (Optional) We provide human player matches datasets: link, password: rm79 (P.S. if you are confused with the dataset, please contact us (botzone@126.com) with the confusing match's data)
  • Submit your AI and compete with each other!

Timeline

  • Registration Deadline: October 31th, 2020 (GMT+8)
  • Round 0 (Simulation Round): ~ October 31th, 2020 (GMT+8)
    • Simulation contests are planned every week, for participants to get familiar with the platform, game rules and contest rules
    • Scores in Round 0 will not be counted
  • Round 1 (Tournament Round): November 1st, 2020 (GMT+8)
    • Swiss-system tournament and Duplicate Format will be used
    • About three rounds will be held in this round, score in each round will be counted as 20%, 30% and 50% to the Round 1 score
    • Three rounds:
      • November 1st, 2020 (GMT+8)
      • November 8th, 2020 (GMT+8)
      • November 15th, 2020 (GMT+8)
    • Top 16 of the Round 1 will proceed to Round 2
    • The pesudo code of contest system is above.
    • Result of Round 1 will be announced on November 21st, 2020 (GMT+8)
  • Round 2 (Final Round): Janurary 1st, 2021 (GMT+8)
    • Swiss-system tournament and Duplicate Format
    • Final Round consists of two stages.
      • Stage 1: 96 rounds of Swiss-system with the same rules to Tournament Round.
      • Stage 2: Top 4 in Stage 1 will have 128 rounds of matches with Duplicate Format.
    • Final result will be announced on IJCAI-PRICAI 2020 session
    • There won't be modification window for bots between the two stages.
  • Note: Click here to get the Duplicate Format rules.

Results Of Tournament Round

Top 16 in Tournament Round are listed here, with the exception of duplication and copycats.

Rank Team Account Score
1清澄高校gameai_platform73.25
2SuperJongyata69.92
3雀圣metaphysics68.22
4ALONGyue66.43
5你能卡掉我我当场把屏幕吃掉infinityedge65.22
6国士无双kczno164.61
7地锅鸡luyd_cpp64.3
8King of gamblerkomqaq64.12
9重在参与工行卡十六号噶64.01
10Luma PoolsTheWitness64.01
11DXzasfs63.71
12自所小分队吧啊咪咪小熊63.61
13点个大的humanfy63.02
14TesthuluBrother63
15我好菜啊啊woaixuexi61.82
16just for funemmmm61.61

Results of Final Round - Stage One

Top 16 in Stage One of Final Round are listed here.

Rank Team Account Score
1SuperJongyata1052.01
2ALONGyue991.00
3清澄高校gameai_platform979.00
4地锅鸡luyd_cpp979.00
5Luma PoolsTheWitness978.00
6国士无双kczno1973.00
7雀圣metaphysics963.99
8你能卡掉我我当场把屏幕吃掉infinityedge962.99
9重在参与工行卡十六号噶961.00
10点个大的humanfy950.00
11King of gamblerkomqaq937.99
12DXzasfs936.99
13TesthuluBrother935.99
14自所小分队吧啊咪咪小熊928.99
15just for funemmmm924.99
16我好菜啊啊woaixuexi904.99

Results of Final Round - Stage Two

Top 4 in Stage Two of Final Round are listed here.

Rank Team Account Score
1 SuperJong yata 1338.00
2ALONGyue1314.00
3清澄高校gameai_platform1281.00
4地锅鸡luyd_cpp1186.98

Paper Submission

  • Paper Submission Deadline: December 15th, 2020 (GMT+8)
  • Acceptance Notification: Janurary 1st, 2021 (GMT+8)
  • Camera Ready Deadline: Janurary 6th, 2021 (GMT+8)
  • Symposium: During IJCAI-PRICAI 2020 session
  • Submission:
    • Papers should be limited to 6 pages plus at most one additional page for references. Papers should include author names and affiliations.
    • Submissions should be formatted in PDF according to IJCAI guidelines and submitted by email to mahjongcompetition@pku.edu.cn.
    • Formatting guidelines and electronic templates are available on the IJCAI-PRICAI 2020 website.
  • Proceedings:
    • Accepted papers will be published on the botzone.org website. Authors will retain copyright and papers can be submitted elsewhere.
  • Symposium
    • Accepted papers will be presented during IJCAI 2020 Mahjong AI competition. At least one author of each accepted paper must register for the Mahjong competition and present the paper at the symposium.
    • The top 16 teams who advance the finals will be given the opportunity to briefly introduce their team, their agent, and the methods and strategies used. Posters are also be encouraged.

Symposium

Rank Team Account Youtube Bilibili Reprt Paper
1 SuperJong yata Video Video PDF
2 ALONG yue Video Video PDF PDF
3 清澄高校 gameai_platform Video Video PDF
4 地锅鸡 luyd_cpp Video Video PDF
5 Luma Pools TheWitness Video Video PPT
6 国士无双 kczno1 Video Video PDF PDF
7 雀圣 metaphysics Video Video PPT
8 你能卡掉我我当场把屏幕吃掉 infinityedge Video Video PDF
9 重在参与 工行卡十六号噶 Video Video PPT
10 点个大的 humanfy Video Video PPT
11 King of gambler komqaq Video Video PPT PDF
12 DX zasfs Video Video PPT
13 Test huluBrother Video Video PPT PDF
14 自所小分队吧 啊咪咪小熊 Video Video PPT
15 just for fun emmmm Video Video PPT
16 我好菜啊啊 woaixuexi Video Video PPT

Committee

Wenxin Li
Professor at Peking University
Xiaotie Deng
Professor at Peking University
Zhihong Deng
Professor at Peking University
Guochuan Zhang
Professor at Zhejiang University
Yang Gao
Professor at Nanjing University
Wenlong Li
General Secretary at Mahjong International League
Weinan Zhang
Assistant Professor at Shanghai Jiao Tong University
Haifeng Zhang
Research fellow at University College London
Yutian Chen
Staff Research Scientist at Google DeepMind
LanZhou Zheng
CTO & Co-Founder at WEIZHIYU (Beijing) Technology co., LTd.

Resources

Our prior work on Mahjong AI and the platform Botzone:

  • Zhou, Haoyu, et al. "Botzone: an online multi-agent competitive platform for AI education." Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education. 2018.
  • Zhou, Haoyu, et al. "Botzone: a competitive and interactive platform for game ai education." Proceedings of the ACM Turing 50th Celebration Conference-China. 2017.
  • Zhang, Haifeng, et al. "Botzone: A game playing system for artificial intelligence education." Proceedings of the International Conference on Frontiers in Education: Computer Science and Computer Engineering (FECS). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2012.
  • Li, Wenxin, et al. "Teaching AI Algorithms with Games Including Mahjong and FightTheLandlord on the Botzone Online Platform." Proceedings of the ACM Conference on Global Computing Education. 2019.

Contact

Organizers

AI Lab, Institute of Network Computing and Information Systems, Department of Computer Science and Technology, School of Electronics Engineering and Computer Science, Peking University, is led by Professor Wenxin Li, AI Lab is dedicated to artificial intelligence in games, as well as computer education, biometric recognition and related fields.
WEIZHIYU (Beijing) Technology Co., Ltd. is a company focusing on artificial intelligence and application of games. With advanced game AI technology and leading industrial share, WEIZHIYU has long-term cooperation with many academic institutes, including Tsinghua University, Peking University, Chinese Academy of Science and Beijing Information Science & Technology University, for cutting-edge artificial intelligence research. The company has a technical team with over 30 people and the core members graduate from famous universities like Tsinghua University and Peking University.

Past Competitions

Competition Prizes
Rank Prize
1st USD 5,000
2nd - 16th USD 1,000
Rules

The rules we adopt in this mahjong competition is Mahjong Competition Rules.

click here to see wiki of mahjong game.
click here to download rules and sample code.
Announcement
  • The results of Final Round (Stage 1 & 2) have been published. Congratulations to SuperJong ! 2021-01-08

    Click here to watch more matches! 2021-01-08

    The Final Round contest system and the results of Tournament Round have been published. 2020-11-16

    The pesudo code of contest system in Tournament Round has been published. 2020-10-28

    Timeline of this competition will be delayed, as IJCAI-PRICAI 2020 is postponed. Details will be revealed in the following days. 2020-05-08

    Click here to see how to use Botzone to join IJCAI 2020 Mahjong AI Competition. 2020-04-20

    IJCAI 2020 Mahjong AI Competition will be held as part of IJCAI 2020 in Yokohama, Japan, July 11-17, 2020. 2020-03-14

    Join the Wechat Group of Botzone. 2020-03-19

    Follow our Wechat Official Account for more information. 2020-03-14