Newt Gingrich served as House speaker from January 1995 to January 1999. He left the job with members of Congress frustrated by his leadership, similar to the circumstances facing Speaker John Boehner, who announced he would leave Congress by the end of October.