How to check historical API usage?

Historical API usage is available through the special API's endpoints. Take a look at the documentation here: https://docs.coinapi.io/management/general 

In addition to that number of requests left is included in every authenticated response header according to the docs: https://docs.coinapi.io/market-data/rest-api#request-limit--apikey