Or just tap the bottom of the screen to go back up a level. (Part of the problem here is your terminology is a little confusing)
Are you trying to swipe down from the list title? You can swipe on the middle of the screen. It works perfectly on my 14 Pro Max.