Use MySQL Workbench to connect to Amazon AWS db

I have been trying to connect to my AWS database using MySql workbench with no luck. I have the database running but cannot connect to it. I have a jdbc url to connect to the aws server. Like this jdbc:mysql://xxxxxxxxx2.c6bdhftggj7t.somestuff.amazonaws.com:3306/mypartofserver I have a username and password so I know where to put them but I don't know how to connect. Should I try Oracle SQL one I think that that one has a JDBC connection. I don't see where to try to connect to the server to add tables and edit them. I am a bit lost here Thank you very much