 Regular article
 Open Access
 Published:
Corporate payments networks and credit risk rating
EPJ Data Science volume 8, Article number: 21 (2019)
Abstract
Aggregate and systemic risk in complex systems are emergent phenomena depending on two properties: the idiosyncratic risk of the elements and the topology of the network of interactions among them. While a significant attention has been given to aggregate risk assessment and risk propagation once the above two properties are given, less is known about how the risk is distributed in the network and its relations with its topology. We study this problem by investigating a large proprietary dataset of payments among 2.4M Italian firms, whose credit risk rating is known. We document significant correlations between local topological properties of a node (firm) and its risk. Moreover we show the existence of an homophily of risk, i.e. the tendency of firms with similar risk profile to be statistically more connected among themselves. This effect is observed when considering both pairs of firms and communities or hierarchies identified in the network. We leverage this knowledge to show the predictability of the missing rating of a firm using only the network properties of the associated node.
Assessing the aggregate risk emerging in complex systems is of paramount importance in disparate fields, such as economics, finance, epidemiology, infrastructure engineering, etc. A large body of recent literature has explored, both theoretically and empirically, how risk propagates [1] and how to assess aggregate risk when the risk of each individual entity is known [2], as well as the topology of the network of interaction among them. Although both aspects have been shown to be important, their mutual relation is relatively less explored. In theoretical studies, one typically assumes independence between idiosyncratic risk and topology, while in empirical studies the correlation is the one present in the investigated dataset.
But what is the relation (if any) between the idiosyncratic risk of a node and its local topological properties (e.g. degree, centrality, community, etc)? In this paper we answer this question by studying a specific system where the assessment of aggregate risk is particularly important, namely the network of interaction between firms. Assessing the risk of firms is one of the fundamental activities of the credit system. Banks spend a significant amount of resources to scrutinise the balance sheet of firms in order to obtain accurate estimations of their riskiness, the internal rating, and provide credit conditions reflecting both the capability of the firm to repay the loans and its probability of default. The riskiness of a firm depends on many idiosyncratic factors (e.g. balance sheet, structure of management, etc.) as well as the industrial sector or its geographical location [3,4,5]. However, corporate firms do not live in isolation, but interact with each other on a daily basis. The interactions can be of different kinds, including those due to the supply chain, payments, business partnerships, financial contracts, and mutual ownership. The structure of interactions is complex and multifaceted, but its knowledge is critical both for macroeconomists and for the credit and banking industry to understand the dynamics of the economy, the business cycle, the structure of corporate control, and, of course, the risk of firms (in isolation or in aggregation).
Here we study the interplay between the risk of firms and the interlinkages connecting them. The network is built from a large proprietary dataset provided by a major European bank. The dataset contains the payments collected at daily granularity between more than two million Italian firms together with the information on internal risk rating for a large fraction of them. We want to understand whether and in which measure a firm’s role in the network can be informative of its riskiness. This is important for two reasons. First, even if the risk of a firm is not known to all the counterparts, it may affect its ability to interact with other firms. For example, a poor rating (i.e. high riskiness) may prevent the access to credit and as a result it may cause a reduction or delay in payments toward suppliers. If the supplier has high risk, the missing or delayed payment can prevent its own payments, increasing the likelihood of a cascade of missing payments and a propagation of financial distress. The second reason is that, in certain cases, the knowledge of the riskiness of a firm or of a group of firms is lacking or imprecise. In these cases, the existence of a correlation between network properties and risk can allow or improve the assessment of risk. Indeed, in the last part of the paper we will show how network properties of a node can be used to predict the risk of the corresponding firm.
Previous works on networks of firms focussed mainly on ownership relations [6,7,8,9,10], or dealt with the theoretical modelling of other types of relation [11]. Exceptions are the empirical studies on the Japanese economic firmtofirm network [12, 13], where links represent buyersupplier relationship. In other cases, as in the seminal paper [14], even if the theoretical framework applies to single firms, the empirical part focuses on the aggregate, sector network, due to lack of more granular data. The use of payments as a proxy of interactions between economic entities is not new and has been investigated mainly for banks [15,16,17,18,19] in the context of systemic risk studies, where, however, other choices to characterise interactions are possible [20,21,22,23]. Apparently much less is known about the payment network between firms, mostly because of lack of data. Concerning rating prediction, there is a vast literature mainly considering the problem as a classification task [24]. The idea of employing machine learning techniques in credit rating scoring has been explored before [25, 26], but in these cases the predictors for the rating are all derived from balance sheets, so the results are not comparable with ours. Other works use more heterogeneous information to predict the rating [27,28,29,30,31].
This paper contributes to these streams of literature in several aspects. First, we investigate the topological properties of payment networks by considering standard network metrics, such as degree and strength distribution and components decomposition. We find that the large payment networks investigated in this paper share the properties observed in other complex networks, namely they are sparse but almost entirely made of a single component, they are scale free and small world. Then, we look into the distribution of risk of firms in the network of payments in order to quantify the dependence between the network property of a node or a group of nodes and the risk of the firm represented by the node(s). The main and most innovative contribution of this paper is to document the existence of such correlations. We find an homophily of risk, i.e. the tendency of a firm to interact with firms with similar risk. This is a two nodes property, but a similar behaviour is observed, even more clearly, also at larger aggregation scales. Communities of firms, detected by using different methods, often display a statistically significant abundance of firms of a specific risk class, indicating the tendency of firms with similar rating to be linked together through payments. Risk is therefore not spread uniformly on the network, but rather it is concentrated in specific areas. This implies that an idiosyncratic shock on a single firm can propagate more or less quickly depending on the local network structure and the community the node belongs to. The last contribution, is to exploit this correlation between risk of a firm and network characteristics of the corresponding node to predict the risk rating of the firm using network properties alone. To this end, we employ machine learning techniques to build classifiers for risk rating whose inputs are only network properties (e.g. degree, community, etc.). We show that our classification method has a good performance both in terms of accuracy and of recall and that outperforms significantly random assignments.
1 The network of payments
1.1 The dataset
The investigated dataset contains information on payments between more than two million Italian firms and is built from transactional data of the payment platform of a major European bank^{Footnote 1} Transactions are registered with daily granularity for the year 2014, for a total of 47M records, each of which includes the two counterparts involved, date, type, amount, and number of transactions in the same day. Transactions are originally identified by account, but in case of customers and former customers, multiple accounts associated to the same firm are aggregated into a single entity.^{Footnote 2} This results in a total of 2.4M entities (which will be referred to as firms, for brevity) operating through the platform during the whole investigated period. The firms can be of different types: customers, who have an account in the bank, non customer, and former customers. There is also a small residual class on NA, which we aggregated with the non customer class. More information on the frequencies of the different classes is available in Appendix 1.
In principle, any firm or public body can make use of the platform, but in practice in most cases at least one is a customer of the bank. Similar considerations hold for the total amount exchanged: in each month more than 50% of the volume is transferred between customers, and it rises to above 95% when considering transaction with at least one customer involved. More details on the dataset and some descriptive statistics is presented in Appendix 1. Finally, for a large fraction of customers, the dataset contains information on the economic sector and on the internal rating of the firm on a three value scale: Low (L), Medium (M), and High (H) risk.
1.2 Networks definition and basic metrics
A network, or graph, is identified by two sets: V, the sets of nodes with cardinality \(\lvert V \rvert =n\), and E, the sets of links or edges, with cardinality \(\lvert E \rvert =m\). The latter is the collection of ordered pairs of connected nodes. In our case, we also take into account the strength of interactions so a weight \(w_{ij}\) is associated with each link. Starting from transaction data, payment networks are constructed as follows: given a time window, each node represents a firm active in that period; if there is payment between two firms a link from the source to the recipient is added, with weight equal to the payment amount. If multiple transactions occur between the same (ordered) pair of nodes, the weight of the link is the sum of the amounts of the payments. Therefore for each time period we construct a directed and weighted network. The time window of analysis may vary depending on the type of information one wants to extract from the dataset. In the following, the focus will be on monthly networks, for which results are quite stable, at the cost of dealing with fewer and larger graphs. For the period covered by the dataset, each monthly network consists on average of \(n=1\)M nodes and \(m=3.2\)M links with the lowest activity in August and the highest in July (see Appendix A.1). The density \(\rho =\frac{m}{n(n1)}\) is thus small, resulting in a so called sparse network. Nevertheless this low density does not imply a disaggregated system. Indeed for all the monthly networks the diameter is very small compared to the size: on average across the months, starting from a node one has to pass at most 19 links to reach any other node in the weakly connected component (see Table 1). Thus the networks have the so called smallworld property.
1.3 Networks topology
When considering a small number of firms, one would expect simple topologies: one firms is the supplier of intermediate products for another firm, resulting in a line (the simplest supply chain), or one firm is a supplier or a buyer for many others firms, resulting in a star network. Instead what is observed is a much more complex organisation, with a non negligible presence of cycles.
At a very coarse level, it is possible to identify two large classes of firms. The first constitute the core of the network, which includes approximately 20% of the nodes and more than half of the links. This core has a density an order of magnitude larger than that of the whole network and it is characterised by the fact that any pair of firms is connected, directly or via intermediaries. Around 60% of the total volume circulates among the nodes of the core (see Table 5 in Appendix 1). The other class is made of payersonly, i.e nodes that have no incoming links. These represent each month about one half of the active firms and their activity is sporadic. To better understand the role of this significant subset of firms we check their customer status and we find that the majority of them are unclassified in terms of client status, and that their number is larger than one expects from the unconditional distribution among all the firms (see Table 6 in Appendix 1). This means that likely they are not customers and, more importantly, almost no information, for example about risk, is available on them. For further details on this refer to Tables 3 and 4 in Appendix 1.
We now turn our attention to the distribution of degree and strength. In our case the in (out) degree is the number of payers (payees) of a given firm and the corresponding amount of Euro. For the monthly aggregation case the average in and outdegree of a firm is 6 and 4, respectively (see Table 1). These low values are a direct consequence of the low density of the network. However the degrees and the strengths are extremely heterogeneous as testified by the degree and strength distribution.
Figure 1 shows the empirical cumulative distribution for these two quantities in a double logarithmic scale. The approximately straight line indicates the presence of a fat tail with a power law behaviour. The fit of the exponent supports the observation that in and out degree distribution data are consistent with a powerlaw tail and the estimated exponents are around 2.6 and 2.8, respectively. Similarly, instrength and outstrength are well fitted by powerlaw distributions of exponents around 2.1 and 2, respectively. Despite the fact that a large fraction of nodes is different in each month, the tail exponents are remarkably stable (see Table 7 of Appendix A.3).
The scale free behaviour is quite ubiquitous in complex networks has been found in many other real economic and financial networks [12, 32,33,34,35,36,37]. The fattailed distribution for the degree has two interesting consequences: first, there is no characteristic scale for the average degree or strength; second, there are a few nodes that act as hubs for the system, in the sense that, having a large amount of connections, many pairs of nodes are connected through them. This partially explains the low values for the diameter.
Finally, we measure the tendency of firms to be connected to firms which are similar with respect to some attribute, namely the number and the total volume of connections (i.e. degree and strength). Following [38], we compute the assortativity coefficient for a categorical variable,
where \(e_{ij}\) is the fraction of edges connecting vertices of type i and j, \(a_{i} = \sum_{j} e_{ij}\) and \(b_{j} = \sum_{i} e_{ij}\). It is \(r_{\mathrm{max}} = 1\) for perfect mixing, while when the network is perfectly disassortative (each node connects to a node of a different type) it is \(r_{\mathrm{min}}=\frac{\sum_{i}a_{i}b_{i}}{1\sum_{i} a _{i}b_{i}}\). Using the number of connections as categorical variable, an high value for the assortativity coefficient indicates that highly connected firms tend to interact significantly more than average with other highly connected firms. Similar reasoning holds using the volume exchanged as categorical variable. Beside the entire graph, we also consider the subgraph of firms with rating and the subgraph of customers.
The assortativity coefficient is consistently slightly negative for both attributes, for all months and graphs, namely around −0.03 for the entire graph and the subgraph of firms with rating, and −0.04 for the subgraph of customers, with no strong differences among months and attributes. Table 8 of Appendix 1 reports the summary of values of the assortativity coefficient for each month. A possible explanation for the low assortativity can be that large, very interconnected firms are connected to many subsidiaries which in turn do not engage with many other firms, being their business almost exclusively focussed on the relationship with the large and central firms.
Summarising, each month the payment network of firms is very sparse but almost entirely connected. Half of the firms appear in the network as payers only (no incoming links) and they are mainly unclassified with respect to customer status, so no much information is available on them. Of the remaining nodes, almost half constitutes the denser core of the network where more than a half of the transactions occur and above 60% of the volume circulates. Finally, the network is small world, scale free, and slightly disassortative both for degree and for strength.
Even if we cannot directly compare the topological properties of our network with other similar ones, we can take as point of comparison other firmtofirm networks commonly used in the literature. The corporate control/ownership networks display typically some similarity with ours, for example sparsity [8, 10], a power law degree distribution [7, 10] with the presence of hubs [10], small diameter [6], and bow tie structure [8].
2 Risk distribution and network topology
In this Section we investigate the distribution of risk of firms in the network of payments. We are interested in measuring the dependence between the network property of a node or a group of nodes and the risk of the firm represented by the node(s). We proceed in a bottomup fashion, zooming out from single nodes to subsets. At first we consider a firm’s local property (the number of connections) and we check if it correlates with the risk. Then we consider pairs of linked firms and measure the homophily in risk, i.e. whether firms with similar risk profile tend to do business together and thus to be linked. Finally, we divide firms into subsets induced by the network structure and we check whether the inferred subsets are informative with respect to the riskiness of the composing firms. Specifically, we partition the network in groups (or communities) of firms by using only network information, and we test if the distribution of risk within each group is statistically different from the global one. Thus the goal is to understand if the inferred communities are homogeneous with respect to the risk profile of the composing firms: a community with many firms with high risk rating is a clear indication of financial fragility and a possible source of instability, since the distress of one or few firms of the community is likely to propagate to the other firms.
For the sake of brevity, in the following the analysis is presented for one month, but results are consistent for all the months, and the complete results are reported in Appendix 2.
2.1 Degree and risk
The first investigation is on the relation between the degree of a firm and its risk. The probability for each risk level \(r\in {L,M,H}\) conditional to the outdegree is computed^{Footnote 3} and plotted against the degree. The results are shown in Fig. 2. We notice an interesting correlation between degree and risk: small degree nodes are more likely medium risk firms, whereas large degree nodes are more likely low risk firms. The high risk firms are more evenly spread across degrees, even if a larger fraction is observed for low degree nodes. To assess if the three curves are statistically different we perform a multinomial logistic regression on data [39] (the solid lines in the plot). This choice is justified by the fact the quantities just described are the probabilities of outcomes in a multiclass problem given an independent variable (the degree). The estimated probabilities follow quite closely the trend of the empirical distribution and the coefficients are all significant. More detailed results of the fit are given in Table 9 of Appendix B.4 (first two columns).
The correlation just highlighted can, at least in part, be influenced by the effect of the size of the firm (in term of assets value from the balance sheet): a large firm is usually considered less risky than a small one. At the same time, a larger size generally implies a higher number of connections, as seen for example in the interbank network [18]. As the size of firms is not available to us, we use the sum of the incoming and outgoing amounts as proxy. Defined in this way, the size has a Spearman rank correlation of 0.67, 0.57 with in and out degree, respectively. To control for the effect of the size, we repeat the same procedure on subsets of firms, grouping according to their size into tertiles. We repeat the multinomial logistic regression adding the size tertiles among the predictors, and we still obtain statistically significant coefficients (last four column in Table 9 of Appendix B.4).
Similarly, the three conditional degree distributions given the rating result statistically different, as for every month all pairs reject the null hypothesis in the 2sample Kolmogorov–Smirnov test [40]. Therefore topological characteristics (the degree) of the node can be used to obtain information on the riskiness of the corresponding firm, even when controlling for size. From a risk management perspective this is an important results, since on average highly connected nodes are also less risky.
2.2 Assortative mixing of risk
The next step is to check whether risk is correlated with direct connection preferences. To clarify this point, we consider two features: the assortative mixing of the risk and the conditional distribution of rating given the distance.
In the first case we compute a weighted variant of the assortativity coefficient in Eq. (1) using as categorical variable the risk rating. When the rating is not available, we assign the node to a residual class.^{Footnote 4} In practice, the quantities \(e_{ij}\) are substituted by \(\tilde{e}_{ij}\), the fraction of volume from nodes of type i to nodes of type j. The reason for this choice is to mitigate the impact of the aforementioned large number of uncategorised payers. In most cases their links are associated with low volume and few transactions. Also, customer firms, even if they represent only around \(1/3\) of the firms, exhibit a generally more intense activity, both in terms of number of transactions and of volume, hence accounting for the stronger ties between the firms.
The assortativity metric is positive for all the three graphs, 0.070, 0.157, 0.163 for the whole set, the nodes with rating, and the customers, respectively, with significant variability across the months but always positive sign.^{Footnote 5} Table 11 of Appendix B.5 reports the summary of values of the assortativity coefficients for each month.
With the same quantities \(\tilde{e}_{ij}\) we define metrics to assess different preferences in connection between incoming and outgoing payments. We test if firms are more concerned with the risk of payers than of the payees by testing for different risk distribution between incoming and outgoing connection. To discriminate between these two cases, for each node i we compute the percentage excess of volume with respect to the average toward nodes in certain risk class and we group according the rating of the node. The distributions are compared using Mann–Whitney U test [41]. This nonparametric test allow to assess if one distribution is stochastically greater than the other. Details on the metrics and the test performed are given in Appendix B.5. We find that it is likely that firms are, at least in part, aware of the riskiness of their counterparts and results suggest they use this information in choosing their business partners. However the hypothesis that incoming payments show a more marked preference for low risk is not supported by data. Moreover the overall positive assortativity is mainly due to low risk nodes. This suggests that low risk firms are more careful in the choice of their business counterparts, possibly also because their relative larger creditworthiness allow them to find available partners more easily.
The quantities considered so far in this section are pairwise comparisons between the rating of nearest neighbours, and give an aggregate measure. A possible^{Footnote 6} way to enrich this information is to consider the conditional distribution of rating for nodes at a given distance^{Footnote 7} and to compare it to the unconditional distribution. In the case of no influence of the rating on the connection pattern, the conditional distribution of risk given the distance should be statistically indistinguishable from the null unconditional distribution. To test if this is the case, we first compute the distance between all the nodes for which the rating is available. Then for any fixed k, the occurrences of ratings are computed by looking at the set of pairs at distance k. Finally, the estimated distributions are tested against the null one with an hypergeometric test, as explained in details in Appendix B.6.
Results for April are summarised in Fig. 3, which considers the case when the source node is in class L (for the others rating and months see Table 12 and Fig. 9 in Appendix B.4). Results are similar when considering a medium or high risk source. For each k a marker indicates the percentage of nodes with low (green circles), medium (yellow squares) or high (red diamonds) risk at distance k. A marker is full when the percentage is statistically different from the null distribution (the dashed lines, with matching colours).
We note that up to distance 5 the class of low risk firms is significantly overrepresented in the distributions. At greater distances, medium and high risk groups are over represented. This means that more steps in the networks are necessary to reach riskier firms. This fact is particularly interesting when considering that each firm is in theory unaware of others firms’ ratings and in some cases even its own.
When considering the same quantities for incoming paths, results (see Appendix B.5, Fig. 9 right panels) are very similar, namely at short distances the low risk class is overrepresented, while medium and high risk nodes are overrepresented for longer distances.
A possible explanation for these observations is that among the hubs of the systems (i.e the most connected nodes) firms with rating L (i.e the most creditworthy) constitute the vast majority. This holds true when considering both incoming and outgoing links, and including also the nodes with no rating. Moreover, they are in the denser core previously described, while many high risk firms have a few or no outgoing links and they are peripheral in network.
2.3 Network organisation and risk
In this Section we study the relation between the organisation of the network at a more aggregate level and the distribution of risk. We are interested in two types of organisation of networks into groups. The first is the modular organisation: each module is composed by nodes, which are much more connected among themselves than with the rest of the network. In economic terms, modules could represent, for example, firms operating in the same region or area, and the high density of the module reflects the fact that payments are more frequent with geographically close firms. We saw before that the network shows an assortative tendency with respect to risk, so we want to test if the homophily on risk can be observed beyond the pairwise relationship.
The second is a hierarchical organisation. Since the payment network is directed, we look for a ranked partition (i.e. each group of nodes is labelled with an integer from 1 to the number of groups M) such that most links are from nodes in low rank classes to nodes in high rank classes. This type of organisation could represent, for example, a supply chain and the flow of payments between the firms of a group and those in the group in the next rank class reflects the (opposite) flow of goods or services. This classification is important because a high risk concentration in low class nodes of a strongly hierarchical network can trigger a cascade of distress in the higher rank classes.
Modularity and hierarchy are conceptually opposite as the first penalises connections towards other groups, which instead are encouraged in the latter (provided that they go from low rank to high rank nodes).
For each metric, we proceed in the following way:

i.
we find the optimal partition according to the criterion;

ii.
we compute the distribution of ratings within each subset of the partition;

iii.
we test whether such local distribution is statistically different from the overall distribution of ratings by employing the hypergeometric test used in the previous Section and described in Appendix B.6. In order to have a large enough sample for testing, we only consider subsets with at least 500 known ratings.
We showed so far that the structure of the payments network is very complex. Since our goal is to obtain information on the risk of the firms, it can be helpful to filter the network before performing communities detection, in order to keep the most relevant connections. Thus we focus on the subgraph of customers. The reasons for this choice are many. First, the percentage of nodes with rating active every month is quite low, around 20%, but it raises to 70% when considering only the customers (see Table 3 in Appendix A.1 for a summary). This will help having a more informative local distribution of risk when considering subsets of nodes. Secondly, more than a half of the volume is transferred between customers (see Table 4 in Appendix A.1), so even if a large fraction of transactions is dropped, we are mostly pruning weak connections, while keeping the strongest ones. Finally, as it has been shown in the previous Subsection about assortativity, considering the entire network can be misleading, especially when looking at the connections without considering the weights, as it will be necessary for some metrics.
2.3.1 Modular structure
One of the standard methods for inferring a modular structure in a network is via modularity maximisation. This method divides nodes into subsets, called modules, such that nodes are well connected with other nodes in the same module and there is a smaller number of links with nodes in other modules. Given a partition P in modules C, the modularity is
where \(A_{ij}\) is the \((i,j)\) element of the adjacency matrix and \(k^{\mathrm{in}}_{i}\) (\(k^{\mathrm{out}}_{i}\)) is the in (out) degree of node i. The optimal partition is the one which maximises modularity. Despite the associated optimisation problem is NPHard, fast and reliable heuristics for an approximate solution exist, and here the well known Louvain method [42] is employed.
In each month we find that the optimal partition has around 2000 modules. These are quite heterogeneous in size: for example, the 13 largest ones cover more than 95% of the nodes of the network. We perform the hypergeometric test of the null hypothesis of an homogeneous distribution of risk. This hypothesis assumes as null distribution of risk the one empirically observed across the entire network (see Appendix B.6 for more details). We perform the analysis in each module with at least 500 known ratings, amounting to around 19 modules per month. (see Table 14 in Appendix B.6 for more details). These are clearly very large modules, but a significant number of them shows an over or underexpression of one or two risk classes.
For some specific module it is possible to draw statistical robust conclusions on its risk profile. The top panel of Fig. 4 shows the over or underrepresentation for the largest modules of January. The seventh module, for example, has an overrepresentation of firms with low risk and an underrepresentation of the other two risk profiles, thus it represents a group of firms with small risk. On the contrary the eighth module has an overrepresentation of highly risky firms and underrepresentation of low risk firms, representing a possible warning for the bank.
2.3.2 Hierarchical organisation
We now consider explicitly the directed nature of the payment graph and the hierarchical organisation of the network. An ordered partition is such that each subset is associated with an integer number (rank) \(r\in \{1,\ldots,M\}\). A graph has a hierarchical organisation if nodes are more likely linked to other nodes with a higher rank [43], such as in military organisations or in administrative staff. Finding the optimal ordered partition and revealing the hierarchy of a graph is in general complex and requires the minimisation of a suitable cost function, similarly to what is done with modularity.
In this paper we use a cost function proposed in [44]. Given a rank function \(r:V\to \{1,\ldots,M\}\), the cost function penalises links from a high rank node to a low rank node. The penalisation is a linear function of the difference between the ranks. Thus the optimal hierarchical partition is obtained by solving the optimisation problem
where \(\mathcal{R}\) denotes the set of all ordered partitions and the cost function is
The hierarchy of the graph is defined by
By definition, \(h\in [0,1]\), and 0 is the value for the trivial partition with only one set, while \(h=1\) is obtained when the network is a Directed Acyclical Graph and it signals a perfect hierarchy. The linear choice of the penalisation function is convenient because the associated optimisation is solvable in polynomial time and few exact algorithms exist [44, 45], while nonlinear forms can lead to NPhard problem.
We apply the hierarchy detection to the monthly networks of payments and the results are summarised in Table 15 of Appendix B.6. First of all we notice that the number of inferred classes, roughly 18, is much lower than in the modular case. Moreover the size of the classes is much more homogeneous. The value of h is also quite stable, around 0.75, indicating a strong hierarchical structure, a remarkable result considering that we are studying only the customers network.
We now consider the distribution of risk in each class and we study the over or underexpression of certain levels of risk as a function of the rank of the class in the inferred hierarchy. The test rejects the null hypothesis of homogeneous risk distribution, the same used in the modular case, a considerable number of times. As displayed in the bottom panel of Fig. 4, low rank classes have an overexpression of high and medium risk firms, while middle and low rank classes (i.e. \(r\in [8,12]\)) have an overexpression of low risk firms and an underexpression of medium and high risk firms. More details on the test results are given in Table 15 in Appendix B.6. This empirical evidence may signal the presence of paths of risk propagation, since low rank firms, typically riskier, are payers of high rank firms, which are instead less risky.
2.4 Discussion
Both investigated partitions give interesting insights on the relationship between risk and network structure. On one side, the percentage of rejected tests in the case of modularity partition is consistent with the observed assortativity of risk. It may be noticed that the preference for low risk business partners is not always a realistic option, because in some sectors business partners are not replaceable for a variety of reasons. To better assess this point, one possibility could be to include the comparison between modules and geographical location of firms, which is not available to us. On the other side, the relation between risk and hierarchical partition is probably related to the peculiar conditional distribution of risk with respect to the distance described in Sect. 2.2. Indeed, given the fact the high risk nodes are overrepresented for longer distances, they should be located in extreme positions in the ranking, either at the top or at the bottom, and this is what is observed. It must be stressed that in the case of the two methods chosen here, one does not exclude the other, as they give different and complementary standpoints for interpretation. In this sense a multidimensional perspective is needed, where the dimensions are the mechanisms that either favour or discourage the creation of business relationships.
3 Missing rating prediction using payments network data
In the previous sections we showed that network metrics can be informative of the risk of a firm. It is therefore natural to ask whether it is possible to predict the missing risk rating of a firm by using only information on network characteristics of the corresponding node, as well as risk rating of the neighbour firms. This problem is particularly relevant since we noticed that around 30% of the customers in the dataset do not have a rating and this percentage is even higher when the entire dataset is considered (see Table 3 in Appendix A.1).
Here we use network characteristics as predictors for the missing ratings into well known methods of machine learning for classification problem. The predictors we employ are the following:

i.
in and outdegree;

ii.
weighted fraction of (in and out) neighbours with a given rating (H, M, L or NA)

iii.
rank of the class in the hierarchy inferred by agony minimisation;

iv.
membership in community inferred by modularity maximisation;

v.
sum of in and outstrength.
The fractions in (ii.) are computed considering the amount (weight) of each payment and are together a measure for rating assortativity, while (v.) is a proxy for the size. Data are preprocessed following [24] so that variables are comparable in order of magnitude, as detailed in Appendix C.7. These transformations result into a total of 25 predictors. The dataset is the one which includes only the customers, and we consider the monthly network for January (see below for the other months). In order to assess the performance of the prediction, we train each model using 75% of the data, and the remaining 25% is used for testing.
We consider three methods for classification:

i.
multinomial logistic;

ii.
classification trees;

iii.
neural networks.
See [24] for a review of these methods.
The class H is underrepresented in the sample, as it includes only around 10% of the firms with rating. This affects the ability of any classifiers to recover this class. This is undesirable, since the class H the most critical for the riskiness.
To address this issue we proceed with a 2step classification strategy for all the three methods. The intuition behind this strategy is to train a classifier more specialised in the recovery of one specific class at the first step, and then separate the remaining classes in the second step. In the first step we fix a risk class, say L, and we merge the other two classes into a fictitious class X. We fit a first instance of the chosen model on the modified database. In the second step, we train another instance of the model only on the two previously merged classes. This is repeated for all the three risk classes. In the case of class H being the one selected for step one, we apply SMOTE [46] before training, a wellknown algorithm for data rebalancing.^{Footnote 8}
Once the models are trained, the prediction are obtained by iterating the following two steps for each risk class (see the schematic representation in Fig. 5)

i.
apply the first step classifier;

ii.
if the entry is classified as X, apply the second step classifier.
The final prediction is the median of the predictions. In case of draw, more weight is given when the class is obtained from the first instance (as the classifier is more specialised). For the 2steps method, the random classifier can be defined in the following way: the null distribution for the first step is obtained for each classifier, by taking into account the fictitious class, and at the second step by considering only the two classes previously merged.
Table 2 shows the results for each classifier, together with the value for the same metrics computed for the random classification. In the case of classification trees and neural networks, different combinations for the hyperparameters have been tested (such as depth for the trees, and number and size of hidden layers for neural networks), here we present the results for the best choice for each model, and in the Appendix C.8 we explain the selecting procedure.
We repeat the procedure also for the other months, using only one hyperparameters choice for each type (the one resulting from the tests on the first month), see Table 16 for details of the results.
The three models behave quite similarly, with slightly better overall performance of neural networks, and the training times are comparable.
It is interesting to study which of the network features are more predictive of the risk. While this is a complicated task for neural networks, it can be performed for classification trees. Figure 6 shows the importance of the predictors in the classification trees. As the 2steps method includes 6 classification trees, we evaluate the importance of features for each classifiers (bars) and then also compute the average (line). We repeat the same for each month and present the average and standard deviation. We observe a good agreement across months, but interestingly less across classifiers in the ensemble (see for example the importance of indegree for step 2 for L classifier with respect to the other classifiers).
From the figure we conclude that the most important features are: (i) in and out degree, (ii) percentage of neighbours with rating L or H, (iii) the proxy of the size, and (iv) the position in the hierarchy. Interestingly, the community to which the node belongs, according to the modularity partition, seems to play a minor role.
It must be noted that, among the predictors only network deduced metrics have been included, while any data from the balance sheet, which is likely to represent the main source for the risk rating model, as well as the sector or geographic location, are excluded. When adding the economic sector, which is the only metadata available to us, as further predictor the prediction power only slightly improves to from 49%–50% to around 52% of accuracy for both classification trees and neural networks. The natural benchmark models are the random classifiers, both 1step and 2steps, due to the total lack of data employed in the proprietary rating model. We are able to outperform the first by 30% to 38%, and the latter by 15% to 22% in term of accuracy, and especially in the case of neural network, we are able to find a good compromise with recall for H.
4 Conclusions
In this paper we empirically study the interactions and the risk distribution of 2 million Italian firms, via the investigation of payments networks built from transactional data.
Our contribution is threefold. On one side, the empirical study of the relationship between the high number of firms to our knowledge has not been done before, especially with this granularity. The study of the structure of the network highlights a complex interdependence between firms; indeed particularly interesting is the presence of a relatively small core of firms, which are involved in most transactions. This feature, paired with the powerlaw tail distribution of the number of connections and the total volume exchanged by the firms, can be a symptom of an architecture which favours the spread of distress, or positive feedbacks. Also relevant is the observed tendency of large, wellconnected firms to be connected to small (in terms of exchanged volume), poorly connected firms. This can be the result of almost exclusive relationships between a big producer and its subsidiaries.
The second and main contribution is the assessment of the correlation between the network structure and the distribution of risk. From our analysis, we conclude that the risk level of a firm is correlated to its features and role in the network at different levels. For single firms, we observed that low risk firms are more likely to have a high number of connections, and some of them acts as hubs for the entire network, being connected to thousands of other firms. When pairs of linked firms are considered, we observed the tendency to favour connections towards firms with the same risk level. This tendency can be observed also on a more aggregate level. Indeed, we found that also groups of firms which are more connected among them than with the rest of the network, have a local distribution of risk which is statistically different from the global one, meaning that some risk classes are over or under represented. Finally, we divided firms into a hierarchical organisation, in such a way to highlight the main direction along which money circulates. This simplified structure showed once more that many levels of the hierarchy have a local distribution of risk statistically different from the global one. As high risk firms are overrepresented at the beginning of the flow of money, this can be a source of distress for the entire system.
Finally, we showed that network metrics and community structure can be successfully used to predict the missing ratings with machine learning models. We propose a simple 2steps strategy to compromise between overall accuracy and recall on the smallest but riskier class. We test our strategy with three methods, namely multinomial logistic, classification trees and neural networks. Since predictors are all networkderived quantities, and no information from balance sheets or other metadata are used, the random rating assignment is the natural benchmark. We find that all the three methods are able to outperform significantly the benchmark, with slightly better results for neural networks.
Notes
The data were obtained thanks to a special agreement between the bank and Scuola Normale Superiore, where the research has been conducted. The data are not owned by the authors and are made available to them only for performing this research. For this reason authors have no permission to distribute the data.
In order to comply with privacy regulation any payment from or to physical persons is excluded. Moreover the filter is implemented to exclude any ambiguous record.
As a robustness check, we consider also specific subgraphs of the network, see below).
Results for the standard assortativity coefficient are quite different, and the choice of the subgraph appears to be crucial. When considering the entire network, the assortativity coefficient is negative, around −0.07, hence indicating a slightly disassortative behaviour with respect to risk. The subgraphs, instead, show an assortative tendency, with coefficients around 0.025 and 0.038 for the nodes with rating and for customers, respectively. This shift can be explained again by the impact of the large number of uncategorised nodes.
An alternative strategy to go beyond first order neighbours in the computation of assortativity has been recently proposed by [54].
The distance between nodes in a network is defined as the length of the shortest directed path connecting two nodes, where a path is a sequence of links. Clearly, in a directed network in general \(d(u,v)\ne d(u,v)\) and moreover \(d(u,v)\) can be not defined (or ∞) if there is no path from u to v.
Using SMOTE in the 1step classification would also be an option if the objective were to use the classifier as a first filter to detect possibly critical nodes. However, we found that the overall performance of the classifier is quite poor, especially when considering the cost of classifying as highly risky (H) a firm which is creditworthy (L).
X indicates the real class, while X̄ indicates the predicted class.
Abbreviations
 L:

Low risk
 M:

Medium risk
 H:

High risk
 NA:

Risk rating not available
 NPHard:

nondeterministic polynomialtime hard problems
 SMOTE:

synthetic minority oversampling technique
 GC:

Giant component
 SCC:

Strongly connected component
 ECDF:

Empirical cumulative distribution function
References
Pozzi F, Di Matteo T, Aste T (2013) Spread of risk across financial markets: better to invest in the peripheries. Sci Rep 3:1665
Nier E, Yang J, Yorulmazer T, Alentorn A (2007) Network models and financial stability. J Econ Dyn Control 31(6):2033–2060
Treacy WF Carey M (2000) Credit risk rating systems at large US banks. J Bank Finance 24(1):167–201
Crouhy M, Galai D, Mark R (2000) A comparative analysis of current credit risk models. J Bank Finance 24(1):59–117
Crouhy M, Galai D, Mark R (2001) Prototype risk rating system. J Bank Finance 25(1):47–95
Kogut B, Walker G (2001) The small world of Germany and the durability of national networks. Am Sociol Rev 66(3):317–335
Souma W, Fujiwara Y, Aoyama H (2006) Change of ownership networks in Japan. In: Practical fruits of econophysics, vol 1. Springer, Berlin, pp 307–311
Vitali S, Glattfelder JB, Battiston S (2011) The network of global corporate control. PLoS ONE 6(10):e25995
Romei A, Ruggieri S, Turini F (2015) The layered structure of company share networks. In: IEEE data science and advanced analytics, DSAA2015. IEEE, pp 1–10
GarciaBernardo J, Fichtner J, Takes FW, Heemskerk EM (2017) Uncovering offshore financial centers: conduits and sinks in the global corporate ownership network. Sci Rep 7(1):6246
Huremovic K, VegaRedondo F (2016) Production networks
Ohnishi T, Takayasu H, Takayasu M (2009) Hubs and authorities on Japanese interfirm network: characterization of nodes in very large directed networks. Prog Theor Phys Suppl 179:157–166
Watanabe H, Takayasu H, Takayasu M (2012) Biased diffusion on the Japanese interfirm trading network: estimation of sales from the network structure. New J Phys 14(4):043034
Acemoglu D, Carvalho VM, Ozdaglar A, TahbazSalehi A (2012) The network origins of aggregate fluctuations. Econometrica 80(5):1977–2016
Soramäki K, Bech ML, Arnold J, Glass RJ, Beyeler WE (2007) The topology of interbank payment flows. Phys A, Stat Mech Appl 379(1):317–333
Rørdam KB, Bech ML et al. (2009) The topology of Danish interbank money flows. Banks Bank Syst 4:48–65
Battiston S, Puliga M, Kaushik R, Tasca P, Caldarelli G (2012) Debtrank: too central to fail? Financial networks, the fed and systemic risk. Sci Rep 2:541
Bargigli L, di Iasio G, Infante L, Lillo F, Pierobon F (2015) The multiplex structure of interbank networks. Quant Finance 15(4):673–691
Fukuyama H, Matousek R (2016) Modelling bank performance: a network DEA approach. Eur J Oper Res 259(2):721–732. ISSN 03772217
Elliott M, Golub B, Jackson MO (2014) Financial networks and contagion. Am Econ Rev 104(10):3115–3153
Cimini G, Squartini T, Garlaschelli D, Gabrielli A (2015) Systemic risk analysis on reconstructed economic and financial networks. Sci Rep 5:15758
Affinito M, Pozzolo AF (2017) The interbank network across the global financial crisis: evidence from Italy. J Bank Finance 80:90–107
D’Errico M, Battiston S, Peltonen T, Scheicher M (2018) How does risk flow in the credit default swap market? J Financ Stab 35:53–74
Friedman J, Hastie T, Tibshirani R (2001) The elements of statistical learning, vol 1. Springer, Berlin
Altman EI, Marco G, Varetto F (1994) Corporate distress diagnosis: comparisons using linear discriminant analysis and neural networks (the Italian experience). J Bank Finance 18(3):505–529
Khandani AE, Kim AJ, Lo AW (2010) Consumer creditrisk models via machinelearning algorithms. J Bank Finance 34(11):2767–2787. ISSN 03784266
Wilson RL, Sharda R (1994) Bankruptcy prediction using neural networks. Decis Support Syst 11(5):545–557
Grunert J, Norden L, Weber M (2005) The role of nonfinancial factors in internal credit ratings. J Bank Finance 29(2):509–531
Lee YC (2007) Application of support vector machines to corporate credit rating prediction. Expert Syst Appl 33(1):67–74. ISSN 09574174
Parnes D (2012) Approximating default probabilities with soft information. J Credit Risk 8(1):3
Martínez A, Nin J, Tomás E, Rubio A (2019) Graph convolutional networks on customer/supplier graph data to improve default prediction. In: Cornelius SP, Granell Martorell C, GómezGardeñes J, Gonçalves B (eds) Complex networks X. Springer, Berlin, pp 135–146. ISBN 9783030144593
Serrano MA, Boguná M (2003) Topology of the world trade web. Phys Rev E 68(1):015101
Garlaschelli D, Loffredo MI (2005) Structure and evolution of the world trade network. Phys A, Stat Mech Appl 355(1):138–144
Boginski V, Butenko S, Pardalos PM (2005) Statistical analysis of financial networks. Comput Stat Data Anal 48(2):431–443
Boss M, Elsinger H, Summer M, Thurner S (2004) Network topology of the interbank market. Quant Finance 4(6):677–684
Kim HJ, Lee Y, Kahng B, Kim I (2002) Weighted scalefree network in financial correlations. J Phys Soc Jpn 71(9):2133–2136
Huang WQ, Zhuang XT, Yao S (2009) A network analysis of the Chinese stock market. Phys A, Stat Mech Appl 388(14):2956–2964
Newman ME (2002) Assortative mixing in networks. Phys Rev Lett 89(20):208701
Greene WH (2003) Econometric analysis. Pearson Education, Upper Saddle River
Smirnov NV (1939) On the estimation of the discrepancy between empirical curves of distribution for two independent samples. Bull Math Univ Moscou 2(2)
Mann HB, Whitney DR (1947) On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 18:50–60
Blondel VD, Guillaume JL, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech Theory Exp 2008(10):P10008
Simon HA (1991) The architecture of complexity. Facets Syst Sci 106(6):457–476
Gupte M, Shankar P, Li J, Muthukrishnan S, Iftode L (2011) Finding hierarchy in directed online social networks. In: Proceedings of the 20th international conference on world wide web. ACM, New York, pp 557–566
Tatti N (2017) Tiers for peers: a practical algorithm for discovering hierarchy in weighted networks. Data Min Knowl Discov 31(3):702–738
Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) SMOTE: synthetic minority oversampling technique. J Artif Intell Res 16:321–357
Clauset A, Shalizi CR, Newman ME (2009) Powerlaw distributions in empirical data. SIAM Rev 51(4):661–703
Newman, M (2010) Networks: an introduction. Oxford University Press, London
Tumminello M, Miccichè S, Lillo F, Varho J, Piilo J, Mantegna RN (2011) Community characterization of heterogeneous complex systems. J Stat Mech Theory Exp 2011(01):P01019
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikitlearn: machine learning in Python. J Mach Learn Res 12:2825–2830
Chollet F et al (2015) Keras. GitHub
Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Mané D, Monga R, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Viégas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2015) TensorFlow: largescale machine learning on heterogeneous systems. Software available from tensorflow.org
Bergstra J, Bengio Y (2012) Random search for hyperparameter optimization. J Mach Learn Res 13:281–305
Arcagni A, Grassi R, Stefani S, Torriero A (2017) Higher order assortativity in complex networks. Eur J Oper Res 262(2):708–719. ISSN 03772217
Acknowledgements
We would like to thank Ilaria Bordino, Francesco Gullo, Francesco Montecuccoli degli Erri, Marcello Paris and Stefano Pascolutti from R&D team in UniCredit for useful discussions and technical support. We are also grateful for suggestions we have received from Giulia Livieri, and the participants to the Data Science Summer School at École Polytechnique in Paris, XLI AMASES Annual Meeting in Cagliari and XVIII Workshop in Quantitative Finance in Milan.
Availability of data and materials
The data that support the findings of this study are available from UniCredit but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are potentially available from the authors upon reasonable request and with permission of UniCredit.
Funding
Authors acknowledge financial support from the grant SNS16LILLO “Financial networks: statistical models, inference, and shock propagation”. FL acknowledges support by the European Community’s H2020 Program under the scheme INFRAIA120142015: Research Infrastructures, grant agreement no. 654024 SoBigData: Social Mining & Big Data Ecosystem.
Author information
Authors and Affiliations
Contributions
All authors conceived the research, EL conducted the empirical analysis. All authors analysed the results and reviewed the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1: Dataset and network metrics
1.1 A.1 The dataset
The dataset is built from transactional data of the payment platform of a major Italian bank for a total of 47M records. Table 3 shows the distribution of rating across the firms, disaggregating them in terms of their customer status. Table 4 presents the details of the exchanged volume by customer status.
1.2 A.2 Time aggregation
When defining a network from temporal data, choosing the time scale of analysis is crucial because it can affect deeply the topology. Shorter time scales (daily or weekly) emphasise peculiar behaviours as, for example, which supplier is paid first once liquidity is available. Longer time scales help giving a more stable picture of the supply chain structure among firms.
In order to give an intuition of different behaviours, two quantities can be considered. The first is the persistence of links and nodes, which is measured by counting the number of times a node or an edge appears in the networks for different time aggregations. From Fig. 7 one can see that most of the nodes are active only for few days, while a small core of firms is intensely active through the whole year. Secondly, the size of the networks, both in terms of number of nodes and links, for different time aggregations is shown in Fig. 8. Interestingly, for daily aggregation, see Left panel, both quantities show a high periodicity, with a very high peak (a factor ∼5 with respect to the other days) at the end of each month. This effect is evident also with weekly aggregation, (see central panel), but not in the monthly time scale. This last observation justifies the choice of monthly networks as focus of this paper.
1.3 A.3 Network metrics
A network’s component is a subsets of nodes such that there is path between any pair of nodes, either undirected (weakly connected components), or directed (strongly connected components). From the definition of the networks it is clear that there are no isolated nodes, since the smallest weak components include at least two nodes, namely a payer and a payee. As it is common for many other real networks, it is possible to identify a weak component, which is of the order of magnitude of the entire network. In our case this giant component (GC) includes on average 98% of the nodes. Considering instead the largest strongly connected component (SCC), it includes approximately 20% of the nodes but more than half of the links. As a consequence the density of the strongly connected component is an order of magnitude larger than the density of the whole network or of the weakly connected component. See Table 5 in for more details of these quantities.
In the standard definition of the bowtie structure of a network, the nodes in the GC but outside the strongly connected component are divided between the incomponent, the nodes from which links arrive in the strongly connected component, and the outcomponent, the nodes reachable from the SCC. Nodes in the incomponent that have no incoming links, represent each month about one half of the active firms and their activity is sporadic.
Appendix 2: Risk distribution
2.1 B.4 Degree and risk
The multinomial logistic regression aims to model the probabilities for a classification problem with more than two outcomes. Here we treat the responses \((L, M, H)\) as categorical and ordered. In practice this means to find parameters that best fit the model
where \(X_{i}\) are the predictors, a and \(b_{\cdot }^{i}\) are the coefficients. We consider the cases \(p=1\), where the predictor is the degree \(X_{1}=k\), and the case \(p=2\) where also the size is used as predictor \(X_{2}=s\). In the following Table 9, the b coefficients are shown, together with an indication for the statistical significance.
2.2 B.5 Assortativity of risk
To test if nodes show different preferences in connection between incoming and outgoing payments we define the quantities
The notation is consistent with the definition in (1): \(r(i)\) is the risk of node i; \(\tilde{a} _{X}\), \(\tilde{b}_{X}\) are the percentage volume from or to nodes with rating X for the whole network, \(w_{i}^{(\mathrm{out})}(X)\) (\(w_{i} ^{(\mathrm{in})}(X)\)) is the percentage of the volume from (to) node i to (from) nodes of rating X. Samples are obtained by grouping nodes by rating, for a total of \(18(=(3\text{ ratings})^{2}\cdot 2\text{ directions})\) distributions. For example, the distribution of excess percentage volume from L towards M is given by
Similarly, the excess percentage volume entering M from H is given by
Note that in general, \(F^{(\mathrm{in})}_{X}(Y)\neq F^{(\mathrm{in})}_{Y}(X)\).
We perform two sets of test. In the first case we fix one rating and we compare out and in excess percentage volume with respect to a certain rating. In all the cases the null hypothesis is rejected with very low pvalues, however it is not straightforward to give an economic interpretation of the overall results: for all the ratings, the excess percentage toward L is greater that the analogous for incoming volume, while the opposite holds for payments to and from H. In the second set of tests we fix a rating and a direction (in or out), and we compare the excess percentage volume from (or to) all the ratings. Also in this case all the tests reject the null with very low pvalues, so we are able to order the distributions and evaluate the preference in connection. For the outgoing volume, rating L is preferred to the more risky ones in all the case. Payments to nodes rated M follows in preference from nodes having risk M and H, but are last in order for nodes having rating L. For incoming payments, the situation is slightly different. Rating M is preferred by nodes rated M and H, and it is followed by L. While the preference is reversed for payments from nodes rated L.
As further robustness check we also compute the closeness centrality for each node and we compare the distribution depending on the risk (see Table 13). The closeness centrality [48] of the nodes is defined as the harmonic mean of the distances to all other nodes. We observe again asymmetry in the position of nodes in the network depending on their rating: closeness for low risk nodes is higher and more spread than that of high risk nodes (0.027 on average across months, and 0.022 respectively) which is a direct consequence of the fact that low risk nodes are more connected.
2.3 B.6 Test for risk distribution within a community
The statistical test employed in the main text has the purpose to assess whether a given rating is under or overrepresented in a certain subset, obtained by one of the partitioning methods described in the paper. In general, this means to test if the distribution of ratings in a single subset is statistically different from the unconditional distribution obtained considering the entire sample. To do so, one computes the pvalue representing the probability to observe a given number of ratings in each community under the null hypothesis of that ratings are distributed in the community as in the whole sample. As shown in [49] the probability under the null is the hypergeometric distribution. Moreover, since for each community multiple tests (one for each rating and community) are performed, a correction for the pvalue for multiple hypothesis testing is used. In particular, the Bonferroni correction is chosen, i.e. fixed a threshold \(p_{s}\) for the pvalue, the corrected threshold is given by \(\frac{p_{s}}{N_{r}}\), where \(N_{r}\) is the number of tests. The threshold of is fixes at \(p_{s}=1\%\) before correction.
Specifically, given a partition \(\{C_{i}\}_{i}\) the following quantities are computed
and the pvalue is given by
Note that \(\{K_{x}\}\) and \(N'\) are computed in the specific monthly network under consideration.
In the case of the distribution conditioned on the distance, the subsets are obtained by considering pairs of nodes. For example, the fraction of nodes with rating L at distance k from H is computed as
The partitions resulting from the other methods are very different in terms of number and size of subsets, so to make tests comparable, only communities including at least 500 nodes with known rating. In the cases of modularity, subsets are ordered by descending size. Note that, since each month the set of active nodes and the labelling of subsets changes, one cannot easily compare the behaviour of a subsets across months.
Tables 14, 15, present a summary of the tests, recording for each month and risk class the number of times the null hypothesis has been rejected, separated in over \((+)\) and under \(()\) representation. The last two columns contain the number classes respectively tested, and in total (nC).
Appendix 3: Classification
3.1 C.7 Data preprocessing
It is well established [24] that rescaling/transforming data in order to have them in \([0,1]\) or in \([1,1]\) or standardised, generally improves the performance of classification, especially when different predictors have very different scale. So, before training the models we perform data preprocessing, in particular:

i.
for in and out degree we use quantile transformation of the logarithm of the degree. This choice is explained by the aforementioned powerlaw tail distribution of these quantities, and aim to avoid too scattered data;

ii.
the predictors for assortativity are already \(\in [0,1]\) so they do not need preprocessing;

iii.
the distribution of nodes into hierarchy classes is standardised, i.e each rank is shifted and rescaled to have mean 0 ad variance 1;

iv.
the module is the only categorical variable. The usual binary transformation would result into a new binary variable for each possible value. As we discussed before, the number of modules is very high but a small fraction of them contains almost all the nodes, so we only keep those that have more than 500 nodes and merge all the remaining into a residual class;

v.
quantile transformation is applied also to the logdistribution of the size.
3.2 C.8 Models training and hyperparameter optimisation
Models training is performed using already implemented packages: for multinomial logistic and classification trees Scikitlearn Python package [50] has been employed, while for neural networks Keras Python package [51] and Tensorflow [52] have been used. However, during optimisation, the parameters defining the architecture of the model, the so called hyperparameters, remain fixed. For this reason, a common practice is to train many models using different values for these hyperparameters and compare performance according to the chosen metric(s). A thorough discussion on this topic is beyond the scope of this paper, we refer to [53] and related literature for detailed information.
Here we apply a simple grid search for the hyperparameters of interest. This has been done for both 1step and 2steps classifiers. The metrics we employ take into account the domain specific interpretation of the risk classes. In particular we want to penalise more misclassification towards lower risk classes, i.e \(M\to \bar{L}\), \(H\to \bar{M}\), \(H \to \bar{L}\),^{Footnote 9} and towards distant classes, i.e \(L\to \bar{H}\), \(H\to \bar{L}\). For this reason, beside the standard accuracy and recall, we also consider weighted scores for accuracy \(\mathit{ws}_{\mathrm{acc}}\), recall \(\mathit{ws}_{\mathrm{rec}}\), precision \(\mathit{ws}_{\mathrm{pr}}\), which are function of the confusion matrix C. With the notation
For classification trees, the hyperparameter of interest is the depth, i.e the maximum number of condition to be satisfied for classification (or the length of the longest path from root to leaves). A higher value for depth results in lower training error but may lead to overfitting. We considered value of depth from 3 to 10. For the 1step model, the tree with depth 6 resulted the best choice, while for the 2steps, the best results have been attained with a depth of 9 for the first step tree and 5 for the second. For neural networks, the hyperparameters of interest are the number and size of hidden layers. As before, increasing too much these values may lead to overfitting. In order to avoid extremely high number of parameters when adding layers, we consistently reduce their size as their number increases (intuitively, the number of parameter grows as \(\prod_{i} \lvert l_{i} \rvert \), where \(\lvert l _{i} \rvert \) is the size of the ith layer). For example, in the case of 1 (hidden) layer the number of nodes is between 10 and 100, while for two layers, it goes from 5 each to 10 each. For the 1step model the best results are obtained with 1 layer of 50 nodes, while for the 2steps the best choice is 2 layers of 5 nodes each for the first step and 1 layer of 10 nodes for the second.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Letizia, E., Lillo, F. Corporate payments networks and credit risk rating. EPJ Data Sci. 8, 21 (2019). https://doi.org/10.1140/epjds/s1368801901975
Received:
Accepted:
Published:
DOI: https://doi.org/10.1140/epjds/s1368801901975
Keywords
 Financial networks
 Corporate networks
 Credit risk
 Credit rating
 Machine learning