The GOP congressman was ousted from the Natural Resources Committee just last week.