The deportees could have been descendants of members of the Windrush generation, named after one of the first ships that brought Caribbean migrants to the United Kingdom in 1948, after the Second World War.
Mr Javid added: "So far we have found - and I would preface these are not final numbers, they are subject to change because the work is still ongoing - we have found 63 cases where individuals could have entered the United Kingdom before 1973, so these are Caribbean Commonwealth [citizens], who could have entered before 1973". He added: "If they feel they have been wrongly deported, it is up to them to do something about it".
He said the figures were provisional.
The Home Office made the discoveries after analysing 8,000 deportation records of Caribbean-born immigrants aged 45 and over.
He said: "I've asked officials to be absolutely certain and thorough and check over every record and make sure".
Sajid Javid told the Home Affairs Select Committee 32 were foreign offenders and 31 people removed by officials rather than a court order.
For weeks, the Home Office under Amber Rudd said repeatedly that they were not aware of any Windrush deportations, although they were checking.
From that number, over 4,482 individuals have been referred to Home Office caseworkers, resulting in over 1,482 appointments being booked.
And he admitted he still had no idea how many Windrush immigrants and their relatives had been detained.
He pinned the blame on Theresa May's vow as Home Secretary to create a "hostile environment" for illegal immigrants.
Sadiq Khan responded to the news on Twitter.
Although fully entitled to live and work in the United Kingdom, an unknown number of Windrush descendants have been wrongly identified as illegal immigrants and denied basic rights such as healthcare.
"Govt must urgently provide answers on exactly how many have been affected, and what action is being taken to right this wrong", he tweeted.
- Watch the new trailer for Mission: Impossible - Fallout called "Payoff"
- Public Advocate Letitia James plans to enter race for attorney general
- Volvo's the latest to ditch diesel
- No Positive Change in Bengaluru Assembly Polls This Year
- Republican's campaign for Georgia governor includes 'deportation bus'
- Why the Premier League transfer window is opening earlier this year
- Pa. Sen. Scott Wagner Wins GOP Nomination To Challenge Gov. Tom Wolf
- The NES and SNES Mini are coming back, pre-orders now open
- Guatemala opens embassy in Jerusalem after USA move
- Hundreds of thousands remain without power after deadly storm pounds US Northeast