CollegeAidAtlasBot
CollegeAidAtlasBot is the small crawler we use to read public financial-aid and admissions pages of U.S. colleges so we can keep this site accurate.
- User-agent:
CollegeAidAtlasBot - It reads only a handful of public pages per college, a few times a year.
- It obeys
robots.txt. If your site disallows it or refuses access, we skip your site and do not try workarounds.
When a college website blocks automated access, an editor may read its public pages in an ordinary web browser, as any visitor can, and record facts from them with the same checks. We never bypass logins, paywalls or security challenges.
To opt out or ask a question, email info@collegeaidatlas.com.