Blocking capacitors are essential for the operation of the amplifier. Without them there is the risk that it suddenly begins to oscillate wildly. In the actual data this might show up as noise because the oscillation is probably in the MHz range and is often not even properly registered by an oscilloscope. To spare you hours of frustration add the 0.1uF blocking capacitor – that's the magical value used (and probably nobody can explain why it's 0.1uF and not 0.2uF).
next step: Fitting the OP-amp