Swae Lee’s not giving Kamala Harris her ‘Sunflowers’ … telling his legion of followers to not vote for the vice chairman in November — and, catching flak on-line for his views. The Rae Sremmurd rapper took to X Sunday to vent his frustrations with VP…