At the point of contact, the radius of the circle is also perpendicular to the tangent. This makes the radius and the perpendicular at the least parallel. The fact that they both intersect at the point of contact makes them coincident. Since they are coincident and the radius originated at the center, the perpendicular must also go through the center.
Hope I helped. :)
