Jessica Simpson's father has hit back at rumors he is gay.

Joe Simpson - who recently announced he and his wife Tina have "amicably split" after 35 years together amid allegations she found pictures of him with 21-year-old aspiring male model Bryce Chandler Hill - is said to be extremely frustrated by the speculation and told friends it is completely false.

Sources close to former pastor have branded the accusations "ridiculous" and told gossip website TMZ.com Joe's sexuality had nothing to do with the break up of his marriage. But other insiders have claimed the 54-year-old father-of-two is simply not ready to come out publicly.

Tina filed for divorce papers in Texas on September 24, stating, "The marriage has become insupportable because of discord or conflict of personalities." The couple put their $4.4 million mansion on the market last month amid speculation they were living apart.