No, it's not the brick-and-mortar kind. The Apple Store Malaysia is a virtual one.
Not like this one:
Apple Store Fifth Avenue, New York
But more like this one -_-"
Apple Store Malaysia
Nonetheless, it's all good cuz there is now an Education Store! If you're a student or teacher, you will get education discounts! For MacBooks, it's RM400 off the normal price!
EDIT:
INDONESIA now also got online Apple Store. Apparently besides Malaysia and Indonesia, a host of other Asian countries also got their online stores.
