She has been staying out of the public's eye for three months and, according to the insider, is desperate to avoid the public scrutiny she faced while dating Tom, 36.
Joe is the first person Taylor has been linked to since she split with the Brit and they have reportedly been dating for months.
He has also appeared in a model shoot with Gigi Hadid, a close friend of the singer.
Joe was educated at the fee-paying City of London School, where Harry Potter actor Daniel Radcliffe also attended, as did Skandar Keynes, who starred in the Chronicles of Narnia film series.
I liked that.'He later studied English and drama at the University of Bristol and London's Royal Central School of Speech and Drama.
Until recently he had been playing football for a team on the Hackney Marshes.
The former couple reportedly called it quits for good in October 2012 when a photo of him kissing a model in Australia circulated around the internet.
They are believed to have started dating early last year but split due to their busy schedules, reconciled late last year but ended it for good following a row during a New Year's holiday to the British Virgin Islands.
A source told Radar Online at the time: 'Taylor was crushed over Harry the first time they dated, and like she always does, she penned a song about him to deal with her broken heart.'I Knew You Were Trouble is one hundred percent about Harry.
Friends close to the couple blamed the split on the singer getting too serious too fast.
Insiders says Taylor - who was four years older - freaked the then 18-year-old by coming on too strong - and because of her apparent obsession with his famous family.
To avoid detection further, the Shake It Off star has been jetting back and forth using her private jet and had security keeping her out of sight at all times.