Hi,
Have you checked the percentage of empty cells based on your 20 genes? It’s likely that with your filter—where you exclude zeros—you are removing up to 80% of the cells in the validation and test sets.
P.S. This question is more about raising awareness.