SCML 2021 League
One of the ANAC 2021 Competition Leagues
Days
Hours
Minutes
Seconds

NEWS

  • 2021.5.17 We published a blog post about SCML standard here.
  • 2021.5.10 We published the first SCML Newsletter today. If you did not receive it by email, you can find it here. To receive future newsletters, please register here
  • 2021.5.10 A new tutorial for the visualizer is now YouTube.
  • 2021.5.10 An updated version of scml and NegMAS are now on PyPi. Please upgrade your development environment.
  • 2021.5.2 The visualizer was improved substantially. You can now visualize contracts, negotiations, and offers. Moreover we added free data exploration to it. Stay tuned for the tutorial.
  • 2021.4.14 A visualizer for SCML was created. You can see a quick introduction about it here

This is the home of the Supply Chain Management League one of ANAC 2021 leagues @ IJCAI 2021.

The main motivation behind the SCM league is to increase the relevance of autonomous negotiation research by focusing on real-world scenarios that are characterized by situated negotiations, and complex dynamic utility functions.

The agent needs not only decide how to negotiate in a predefined single negotiation session, but when to join negotiations, and how to coordinate the behavior of its negotiators across multiple concurrent negotiations.

It is highly recommended to register your interest in the league by registering to this website by May 30th (No need to upload an agent by that time). It is mandatory to upload a preliminary version of the agent by July 5th.

Please note that the score on the live-competition will not impact in any way your final score in the official competition to be announced at IJCAI 2021.

The live competition is run using fewer configurations than the official competition to facilitate faster feedback when submitting new agents. This may lead to different results in the official competition.

Changes from SCML 2020

The main differences SCML 2020 and SCML 2021 can be found here.
  • Agents will have access to more information about the market to help them develop their strategies. These are specifically trading prices and exogenous contract summary (See Section 5 of the game description).
  • We introduce a simpler form of the game running in the same environment as a third track called SCML-OneShot. An overview of of this simpler form is found here. The full description of this simpler form is found here. The main differences between SCML-OneShot and the other two tracks can be found here.
  • New in May 10th, 2021 The truncated mean will be used instead of the median for comparing agents.
  • The evaluation criteria for the collusion track will be slightly modified to take into account a “the consolidated financial state” of all factories run by the same participant. More specifically, the total balance (and inventory) of all factories controlled by an agent type will be aggregated before calculating the profit giving a single score for the agent type in every simulation instead of three as was the case in 2020. This means that median-pumping by getting one factory to lose while pushing the profits of the other two up will not be effective in 2021.
  • Finalists for the “collusion” track MUST have a dedicated “collusion strategy” section in their reports with a non-trivial strategy for colluding among their factory managers.
  • We created discussion rooms for the three tracks here to help participants get together and contact organizers. You can also report bugs, feature requests and open new discussion topics on the same page.

Getting started and getting help

  1. The first thing you need to do is to read the game overview for the one shot track and/or the standard/collusion tracks.
  2. If you are not registered here, do so to received updates and be able to submit your agents later here.
  3. After deciding which track(s) to participate in, check there detailed description( OneShot Standard/Collusion).
  4. Next, Check the tutorials. You can find video tutorials and consult the documentation and we are happy to see you joining the discussions.
  5. Next, Download the appropriate skeleton (OneShot or standard/collusion) and test it. You will find a full description on how to do that in the README as well as the docstring on top of myagent.py in the skeleton .
  6. Happy hacking :-) If you have any questions, bug reports, feature requests, etc, you can open an issue on the SCML GitHub page

Links

Important Dates

Registration (Optional)May 30th
Preliminary SubmissionJuly 5th
Last Online TournamentJuly 6th
Final SubmissionJuly 10th
Finalist AnnouncementJuly 31st
Winner AnnouncementAugust

Statistics

Past Competitions

Leader Board (OneShot)

Based on the tournament run on 2021-05-14 02:39:44 UTC.

# Agent Score
1 Greedy SA Agent 5,976
2 Greedy Sync Agent 5,969
3 Greedy Agent 5,889
4 Aspiration SA Agent 5,772

Next run is scheduled on 2021-05-21 02:39 UTC

Running next (22 Competitors):

Leader Board (Standard)

Based on the tournament run on 2021-05-15 04:56:36 UTC.

# Agent Score
1 Merchant 64
2 CrescentAgent 0
3 Whagent -3
4 M4 -65
5 MontyHallv23 -118
6 SteadyMgr -143
7 THBiuAgent -412
8 jamesbond -425
9 GreedyFactoryManager2 -429
10 UEYBIU -435
11 DoSomething -535
12 SavingAgent -563
13 BeerAgent -563
14 ASMASH -595
15 Aryabhata -598
16 MA Decentralizing -631
17 BARGent_Covid19 -638
18 Ashgent -731
19 MercuAgent -1,078
20 Agent32 -2,944

Next run is scheduled on 2021-05-22 04:56 UTC

Running next (22 Competitors): DoSomething, Aryabhata, SteadyMgr, Whagent, MercuAgent, Ashgent, SavingAgent, BARGent_Covid19, THBiuAgent, ASMASH, Agent30, Agent15Fork, Agent32, BIUDODY, BeerAgent, jamesbond, UEYBIU, GreedyFactoryManager2, M4, CrescentAgent, MontyHallv23, Merchant,

Leader Board (Collusion)

Based on the tournament run on 2021-05-14 04:14:19 UTC.

# Team/Agent Score
1 Merchant 72
2 Whagent 1
3 CrescentAgent 0
4 GreedyFactoryManager2 -100
5 MontyHallv23 -116
6 SteadyMgr -227
7 M4 -291
8 jamesbond -405
9 SavingAgent -406
10 ASMASH -510
11 THBiuAgent -551
12 Ashgent -572
13 UEYBIU -576
14 Aryabhata -594
15 BARGent_Covid19 -632
16 MA Decentralizing -658
17 BeerAgent -775
18 MercuAgent -832
19 DoSomething -950
20 Agent32 -3,913

Next run is scheduled on 2021-05-21 04:14 UTC

Running next (22 Competitors): DoSomething, Aryabhata, SteadyMgr, Whagent, MercuAgent, Ashgent, SavingAgent, BARGent_Covid19, THBiuAgent, ASMASH, Agent30, Agent15Fork, Agent32, BIUDODY, BeerAgent, jamesbond, UEYBIU, GreedyFactoryManager2, M4, CrescentAgent, MontyHallv23, Merchant,