Fat mass and obesity-associated protein (FTO) is the first discovered RNA N6-methyladenosine (m6A) demethylase. The highly expressed FTO protein is required to trigger oncogenic pathways in acute myeloid leukemia (AML), which makes FTO a promising antileukemia drug target. In this study, we identify 3-arylaminothiophenic-2-carboxylic acid derivatives as new FTO inhibitors with good antileukemia activity. We replaced the phenyl A-ring in FB23, the first-generation of FTO inhibitor, with five-membered heterocycles and synthesized a new class of FTO inhibitors. Compound 12o/F97 shows strong enzymatic inhibitory activity and potent antiproliferative activity. 12o/F97 selectively inhibits m6A demethylation by FTO rather than ALKBH5, and has minimal effect on m1A demethylation by ALKBH3. Additionally, 12o/F97 increases the protein levels of RARA and ASB2, while decreasing that of MYC in AML cell lines. Lastly, 12o/F97 exhibits antileukemia activity in a xenograft mice model without significant side-effects. The identification of 3-arylaminothiophenic-2-carboxylic acid derivatives as new FTO inhibitors not only expands the chemical space but also holds potential for antileukemia drug development.