Writing It Up · Medium problem

The lesson proves $24 \mid p^2 - 1$ for primes $p > 3$ and says the proof must use "$p > 3$". For how many primes $p$ does $24 \mid p^2 - 1$ FAIL?