The states that grew fast during the real estate boom are now experiencing declines, the Census Bureau reported.