Although it is possible to script more autotiles if you re-wrote nearly the entire Tilemap class, you would never be able to view their effect in the editor. You would need to re-write the editor for it to use them. So for all intensive purposes of doing this in RMXP, it isn't going to happen.