There is a 69-place gap between George Elkobi's Kent-based club and third-tier Stevenage.
But in their first third round appearance since 1988, the National League South minnows made history as Sam Corne netted a penalty in first half stoppage-time before fans flooded the pitch in celebration at the final whistle.
In Saturday's other early third round ties, Leicester took a break from their Championship promotion push to beat Millwall 3-2 at The Den.
Ten points clear at the top of the Championship, the 2021 FA Cup winners were able to rest several players and still saw off Millwall through goals from Cesare Casadei, Ricardo Pereira and Tom Cannon.
Ipswich, who are second to Leicester in the Championship, moved into the fourth round with a 3-1 win at League Two side AFC Wimbledon.
There were scares for Premier League sides Bournemouth and Brighton before they reached the last 32.
Bournemouth came from two goals down at half-time to win 3-2 at second tier QPR via strikes from Marcus Tavernier, Kieffer Moore and Justin Kluivert.
Inspired by Joao Pedro's double, Brighton won 4-2 at Championship outfit Stoke despite falling behind early on.
Sheffield United, bottom of the Premier League, cruised to a 4-0 victory at fourth tier Gillingham.
Chesterfield, who sit top of the fifth tier National League, nearly stunned Championship club Watford, taking the lead at Vicarage Road before losing 2-1.
Ten-man Eastleigh, another of the four non-league teams in the third round, earned a creditable 1-1 draw at fourth tier Newport.
Chelsea goal spree
At Stamford Bridge, inconsistent Chelsea dismissed Preston with three goals in 11 second half minutes.
Blues boss Mauricio Pochettino has urged his players to use the FA Cup as a route into Europe given their dismal form in the Premier League.
Heeding that message, Armando Broja headed home to break Preston's resistance in the 58th minute.
Thiago Silva nodded in the second from a corner and Raheem Sterling grabbed the third with a fine free-kick.
Enzo Fernandez tapped in to complete the rout in the 85th minute.
Aston Villa, just two points behind table-topping Liverpool, needed an 88th minute strike from Matty Cash to see off Championship side Middlesbrough at the Riverside Stadium.
Cash's shot took a wicked deflection off Middlesbrough's Emmanuel Latte Lath to spare Villa an unwanted replay.
