Tests of the superconducting cavity maser (SCM) ultra-stable frequency source have been made for the first time using a hydrogen maser for a frequency reference. In addition to characterizing the frequency stability, the sensitivity of the output frequency to several crucial parameters was determined for various operating conditions. Based on this determination, the refrigeration and thermal control systems of the SCM were modified. Subsequent tests showed substantially improved performance, especially at the longest averaging times.