Most custom dialects are written by forking an existing dialect.
Unfortunately, a dialect can not accomplish what you want to do.
SqlAlchemy Dialects are used to generate SQL, which is then passed to the database via a DBAPI driver.
For example, when someone uses PostgreSQL with SQLAlchemy, they use the SQLAlchemy postgresql dialect AND their choice of a DBAPI driver (which could be any one of psycopg2, psycopg 3, pg8000, asyncpg, psycopg2cffi, etc)
There are a few independent projects that developed REST solutions by writing both a dialect AND a DBAPI driver into a single package.
Examples include:
You will need to implement a solution similar to one of the above projects.