I couldn't stand having a blurry image, so when I got home this evening at about 7:30, I climbed the ladder again. I saw that the nest was empty and removed the set screw that locked the focus. I was able to do this by swiveling the camera around until it pointed straight in the air. It was an awkward moment doing this on top of the ladder but by having my laptop outside with me, I was able to get it in better focus by looking down at the video as I was adjusting it.
That's it. No more messing with it. Now to see when the birds come back.