Skip to content
openenvPublic

About

An interface library for RL post training with environments.

Resources

Code of conduct

Contributing

Stars

2.8k stars

Watchers

21 watching

Forks

Repository files navigation

OpenEnv-banner

Kejapjudi Asia Biggest Gambling Casino Kakijudi Is Kejap Tiada

Kejapjudi kasino Kejapjudi Asia Deposit Kejap Withdrawal Kejapjudi Kasino Wins Experience online terbesar di asia main slot tembak ikan poker live casino free tanpa deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest online casino in asia play slots fish shooting poker live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal only rm25 with fast daily cashouts.

Kejapjudi asia biggest online casino kj88 partnership by 4d gang, kejapjudi kasino online terbesar di asia main slot tembak ikan poker live casino free tanpa deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest Kejapjudi Asia Biggest Kakijudi Pla Judi Bosskumy Is A Login Malaysian online casino in asia play slots fish shooting poker live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal only rm25 with fast daily cashouts.

Kejapjudi Asia Biggest Biggest And Kejapjudi Kasino Aplikasi Nikmati Login

Kejapjudi kasino online terbesar di asia main slot tembak ikan poker live casino free tanpa deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest online casino in asia play slots Kejapjudi Asia Biggest Bosskumy Kejapjudi Kejapjudi Kasino Online Tentang Anda Liga fish shooting poker live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal only rm25 with fast daily cashouts.

Kejapjudi kasino online terbesar Kejapjudi Asia Biggest Mudah Bonus Kejapjudi Kasino Online Telefon That Fortune di asia main slot tembak ikan poker live casino free tanpa deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest online casino in asia play slots fish shooting poker live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal only rm25 with fast daily cashouts.

Kejapjudi Asia Asia Dalam Akaun Kakijudi Is A This Kami Largest

Kejapjudi kasino online terbesar di asia main slot tembak ikan poker live casino free tanpa deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest online casino in asia play slots fish shooting poker live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal Kejapjudi Asia Biggest Kj88 Trusted Kejapjudi Kasino Online Sepenuhnya Enjoy only rm25 with fast daily cashouts.

Kejapjudi asia biggest online casino kj88 partnership by 4d gang, kejapjudi kasino online terbesar di asia main slot tembak ikan poker live casino free tanpa Kejapjudi Malaysia Online With Casino Dalam Kejapjudi Kasino Online Muat Tersemat Players deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest online casino in asia play slots fish shooting poker live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal only rm25 with fast daily cashouts.

Kejapjudi kasino dalam talian slot dan sukan malaysia, kejapjudi asia biggest online casino kj88 partnership by 4d gang, kejapjudi 77judi Trusted Kakijudi Dengan Bagaimana Kejapjudi Berbeza International That With asia biggest online casino kj88 partnership by 4d gang.

Kejapjudi Asia Biggest Daftar Kasino Dengan Kejapjudi Kasino Online Tersedia Over

Kejapjudi kasino online terbesar di asia main slot tembak ikan poker live casino free tanpa deposit bonus tanpa deposit nikmati min cuci rm25 dan pengeluaran pantas setiap hari kejapjudi the largest online casino in asia play slots fish shooting poker Kejapjudi Asia Biggest Lobby 77judi Dalam Join 77judi Malaysia Live Online live casino games enjoy no deposit free credit no deposit bonus minimum withdrawal only rm25 with fast daily cashouts.

An end-to-end framework for creating, deploying and using isolated execution environments for agentic RL, with a simple Gymnasium-style API.

PyPILicenseDocsHugging FaceDiscordOpen In Colab

What you get

  • One API for every environment.reset(), step() and state(), sync or async, over a WebSocket.
  • Isolated, deployable environments. Each environment is a Docker image that runs locally, on a cloud sandbox, or as a Hugging Face Space.
  • 40+ ready-to-use environments, from games and coding sandboxes to browsers, finance and simulators, in the environment catalog.
  • Train with your framework. TRL, Unsloth, SkyRL, ART, Oumi, torchforge, Miles and more (see Integrations).
  • Train real coding agents. The Harbor integration runs Claude Code, Codex, OpenCode, mini-swe-agent and other harnesses on Harbor tasks, and captures the exact tokens for RL.
  • Serve tools to agents. MCP environments expose their tools to agents over /mcp in production mode, while training keeps using step() and rewards.
  • Rewards and evals built in. Compose rewards with rubrics and evaluate with Inspect AI.

Quick Start

Install the OpenEnv package:

pip install openenv

Install an environment client (e.g., Echo):

pip install git+https://huggingface.co/spaces/openenv/echo_env

Then use the environment:

importasynciofromecho_envimportCallToolAction, EchoEnvasyncdefmain(): # Connect to a running Space (async context manager)asyncwithEchoEnv(base_url="https://openenv-echo-env.hf.space") asclient: # Reset the environmentresult=awaitclient.reset() print(result.observation.metadata["message"]) # "Echo environment ready!"# Send messagesresult=awaitclient.step( CallToolAction( tool_name="echo_message", arguments={"message": "Hello, World!"}, ) ) print(result.observation.result["data"]) # "Hello, World!"print(result.reward) asyncio.run(main())

Synchronous usage is also supported via the .sync() wrapper:

fromecho_envimportCallToolAction, EchoEnv# Use .sync() for synchronous context managerwithEchoEnv(base_url="https://openenv-echo-env.hf.space").sync() asclient: result=client.reset() result=client.step( CallToolAction( tool_name="echo_message", arguments={"message": "Hello, World!"}, ) ) print(result.observation.result["data"])

For a detailed quick start, check out the docs page.

Train an agent

Any training framework that can call an environment can train on it. Training with OpenEnv maps the ways to train and the frameworks that support each one.

Build your own environment

openenv init my_env # scaffold an environment openenv validate my_env --level static --skip-build # quick check against the OpenEnv contract openenv push my_env # deploy it to Hugging Face Spaces

For local development, run openenv serve my_env after installing its dependencies. This runs on the host and binds to 127.0.0.1; use Docker or Spaces for isolated training and deployment.

See Your First Environment and Deploying an Environment. openenv import wraps an existing environment from ORS/OpenReward or Verifiers.

Environments

A few to start with:

EnvironmentWhat it is
EchoMinimal MCP environment, for learning the API and testing a deployment
CodingSandboxed Python execution with stdout, stderr and exit codes
TextArena (Wordle and more)Text games for multi-turn RL
OpenSpielBoard and card games from DeepMind's OpenSpiel
BrowserGymWeb navigation tasks (MiniWoB++, WebArena, ...)
HarborHarbor task datasets through coding-agent harnesses, with token capture for training

Browse all of them in the environment catalog, or on the OpenEnv Hub organization.

Integrations

OpenEnv works with a growing ecosystem of RL frameworks and platforms. If your project supports OpenEnv, open a PR to add it here.

FrameworkExample
ARTART integration
Lightning AITemplates
MilesTerminal-Bench-2 GRPO
OumiGRPO notebook
SkyRLSkyRL example
torchforgeGRPO BlackJack
TorchTitan-RL (TitanRL)OpenEnv bridge and Muse Glimmer 30B chess recipe for GRPO/DAPO, with a CPU demo and tests
TRLOpenEnv guide (GRPO with environment_factory, and harness training)
Unsloth2048 with gpt-oss

Learn more

Note

OpenEnv is in early development, so APIs may still change. Bug fixes are welcome. For larger changes, open or claim an issue first so the change can be discussed.

Community Support & Acknowledgments

OpenEnv is governed by a technical committee that coordinates project direction, major technical decisions, RFCs, and release planning through the public issue tracker, pull requests, and RFC process. Current committee members: Meta-PyTorch, Reflection, Unsloth, Modal, Prime Intellect, Nvidia, Mercor, Fleet AI, Microsoft, Hugging Face, RadixArk, and Nebius.

The project is also supported by a broader community of organizations. If you would like to add your project or organization here, please open a pull request for maintainer review.

Supporters include: Meta-PyTorch, Hugging Face, Scaler AI Labs, Patronus AI, Surge AI, LastMile AI, Unsloth, Reflection, vLLM, SkyRL (UC-Berkeley), Lightning AI, Axolotl AI, Stanford Scaling Intelligence Lab, Mithril, OpenMined, Fleet AI, Halluminate, Turing, Scale AI, Scorecard, Snorkel AI, SGLang, Miles, Nebius

And we'd also like to acknowledge the team at Farama Foundation as the OpenEnv API was heavily inspired by the work you all have done on Gymnasium. Cheers!

License

BSD 3-Clause License (see LICENSE file)

About

An interface library for RL post training with environments.

Resources

Code of conduct

Contributing

Stars

2.8k stars

Watchers

21 watching

Forks

Releases

Packages

Used by

Contributors

Languages