Is H1B petition not valid as I did not work in US nor Visa is stamped in passport?

Legally, H1B petition stays valid but the chances of H1B transfer approval get low as you have not activated it by entering US on H1B visa.

I have answered same question in detail earlier here: