Direct Proof · Medium problem

Every perfect square leaves remainder $0$ or $1$ on division by $4$. How many integers from $1$ to $100$ does this fact alone show are NOT sums of two squares?