Thanks @feevos
Now issue resolved related to distributed training.
but my other main concern is here Autogluon simple program failing with distributed training - #8 by hariram
(last but one post - which i think there is no implementation of it yet.)