Ended up using a web server internally (WSUS server) to host the rpm file, and then used wget to grab the file to the appliance. It's installed now.
ssh access is not supported in Access Point
on the other hand using external Wsus and update with wget is a cool solution
Really, any http-based web server is fine as long as access point appliance can reach it via wget.