Voter Fraud...a huge issue for 2012

Why is it so difficult to get a handle on Voter Fraud? Every citizen of the US must have a SS card, if they want to work, or get entitlements. It's simple! One SS number(of age)...one vote! That's it! If computers detect 2 or more people try to vote with the same number, those ballots are kicked out and investigated.