What kind of response should I return when building a client library?

I'm currently developing a client library for Gengo in Go. There are many resources on how to build a good API but I haven't found anything on how to build a good client library.

One of my main questions is, in my response should I be returning a simple JSON or a Struct (objects) for each response?