Based on th picture, you should be able to remove a soffit panel to do this. I believe you are thinking of the facia. The facia is the white trim running vertical on the building. There is a lip on the facia. You can bend the lip enough to allow room for a soffit panel to come out. Just be cautious when bending. You have to get them back in place and look good. I could be wrong here. I going off your pic