Your file was not written with a BinaryFormatter - so you can't read it back with one.
A quick look at the data shown in your error message would indicate that it is raw binary data, possibly the 32 bit integers 20, 0, 0, 20
A binary formatter output file looks more like this:
0001000000FFFFFFFF01000000000000
0004010000000C53797374656D2E496E
74333201000000076D5F76616C756500
08140000000B0001000000FFFFFFFF01
0000000000000004010000000C537973
74656D2E496E74333201000000076D5F
76616C75650008140000000B
That, by the way, is for the two integer values "20" and "20" - but the binary formatter adds the class names and related info to it.
You either need to look at the data writer, or modify your code to read raw data - if you know what the content is supposed to be, that would help.