First replaced the gas valve solenoids but that wasn't it. After further research, replaced the gas valve. The lock arm support on the new one didn't line up with the dryer lock base but I just bent the arm back a little to fit. Made sure to use gas tape (thicker) when reconnecting the gas pipe. Verified no leaks.
No more high pitched buzzing noise.