Should I flirt back with him or not?

It is harmless flirting. Try to flirt at the same level as he does for awhile. If things are going OK try to get a little "accidental" body contact and see how he reacts. If he smiles, that's good.