This study and research aimed is to classify and predict the credit card default customers payment by means of contemporary approach of artificial neural network (ANN) known as deep neural network. This paper explains the dataset which signifies Taiwan credit card defaults in 2005 and their previous payment histories taken from popular machine learning dataset resource known as UCI. The paper enlightens each and every concept and step require to build, train, validate and test a deep neural network model for classification task that has never been discussed before. Moreover, we tried to elaborate the relevant and important concepts associated with deep neural network model that must be kept in mind during model building. This paper mainly tries to classify the default payment customer with more than 82% accuracy. For this purpose, various deep neural network techniques with different libraries are used to attain maximum accuracy and we have tried to build a best possible model which can be used for future prediction. This study proves deep neural network is the only one that can accurately estimate the real probability of default. So, by using this network model, which is more complex, sophisticated and most widely used than a simple neural network and logistic regression model, the classification simulation shall have a better performance and accuracy.