Yes both numbers seem high to me. We generally shoot for a close to zero toe as possible, and that is with someone sitting in the seat, tires properly inflated, etc. If you are measuring total toe, depending on where the steering center is, most of that might be on the side which is wearing poorly.
Same for camber, and that typically increases with load. Add a driver, and the number probably will go up. Karts don’t need front tires tipped in at the top like are seen on the current Indy cars.
A good place to start, if you can get even half a day to test, is to go to zero for toe and camber, and the middle setting for caster. From there you can check results of track width changes (easy to do, relatively) and caster adjustments. Understeer/slow response = add caster, Oversteer/twitchy = reduce caster.
As it is, the numbers you list for camber and toe probably are to blame for the wear you see on the inner section of the tire tread.
Here is a thought: Instead of pulling the kingpin bolts, just loosen and spin them with a wrench or socket. If a spindle waves around as the bolt is turned, that bolt is bent. Replace it before making adjustments!
