Hi Tom,
Thank you for help.
If I remove menu from the top bar then again admin bar is visible. For the time being I am removing this menu.
Now I feel that limit of 50kb for CSS by AMP might be the reason.
https://github.com/ampproject/amp-wp/issues/1800
Will keep an eye if other people are facing same issue. Please update if you find something related to this.