It was actually "paved with cheese." During that era, people in other countries would tell tall tales about the streets of America being paved with gold, so with the mice, it was cheese.