Except as provided in section 3674A of this title, no department, agency, or officer of the United States, in carrying out this chapter, shall exercise any supervision or control, whatsoever, over any State approving agency, or State educational agency, or any educational institution. Nothing in this section shall be deemed to prevent any department, agency, or officer of the United States from exercising any supervision or control which such department, agency, or officer is authorized by law to exercise over any Federal educational institution or to prevent the furnishing of education under this chapter or chapter 34 or 35 of this title in any institution over which supervision or control is exercised by such other department, agency, or officer under authority of law.