I have some of the Adafruit graphic displays working on my Edison. I am using the Adafruit 2.8" TFT shield currently on my Arduino breakout board. This board works using SPI communications.
Not sure which adafruit display you have. If you are using their 2.8" shield, I believe it uses the same ILI9341, so my ported drivers should work. Note I believe this board uses different IO pins for TFT chip select and Data/Command, so you would need to pass in different IO pins.
Also if using that above board, it does not have the touch screen controller the adafruit one does, so you would need to port a version of the touch library to work.
I have talked about my stuff in a few different threads including: Support for the Adafruit 2.8" TFT display for Arduino Edison