First, fetch the configuration from the application for which you want to calculate the record count (learn how).
Then, navigate to your settings area, from the left pane's bottom section:
Click on the PLAN & USAGE tab, and scroll to the Usage section:
In this section, you'll find the applications you've fetched, along with a breakdown of elements for the ones you're interested in counting: