Skip to content

README.md

Latest commit

 

History

History
45 lines (33 loc) · 2.31 KB

README.md

File metadata and controls

45 lines (33 loc) · 2.31 KB

Flatland Baselines

🚂 This repo provides baselines for the Flatland Benchmarks hosted at fab.flatland.cloud and the scenarios in the Flatland scenario repository flatland-scenarios.

📊 Flatland Benchmarks (FAB) is an open-source web-based platform for running Benchmarks to foster Open Research.

🏆 Flatland 3 Benchmarks follow up on the Flatland 3 Challenge. More precisely, Flatland 3 Benchmarks follow Flatland 3 Challenge's Round 2 Environment Configurations, having the same environment configuration but generated with different seeds.

Baselines provided:

TL;DR;

Run baselines with debug environments:

docker compose  -f demo/docker-compose.yml up --force-recreate --build

Output:

evaluator-1       | ====================================================================================================
evaluator-1       | ####################################################################################################
evaluator-1       | EVALUATION COMPLETE !!
evaluator-1       | ####################################################################################################
evaluator-1       | # Mean Reward : 0.0
evaluator-1       | # Sum Normalized Reward : 5.0 (primary score)
evaluator-1       | # Mean Percentage Complete : 1.0 (secondary score)
evaluator-1       | # Mean Normalized Reward : 1.0
evaluator-1       | ####################################################################################################
evaluator-1       | ####################################################################################################
evaluator-1       | \ end grader
evaluator-1       | \ end evaluator/run.sh
evaluator-1       | + echo '\ end evaluator/run.sh'
submission-1 exited with code 0
evaluator-1 exited with code 0