master

分支 (1)

管理

管理

master

named_entity_recognition
/
output.txt

读取数据...
加载并评估hmm模型...
           precision    recall  f1-score   support
    E-EDU     0.9167    0.9821    0.9483       112
   B-RACE     1.0000    0.9286    0.9630        14
  E-TITLE     0.9514    0.9637    0.9575       772
   B-NAME     0.9800    0.8750    0.9245       112
   M-NAME     0.9459    0.8537    0.8974        82
   M-CONT     0.9815    1.0000    0.9907        53
    M-ORG     0.9002    0.9327    0.9162      4325
   B-CONT     0.9655    1.0000    0.9825        28
    B-EDU     0.9000    0.9643    0.9310       112
    B-LOC     0.3333    0.3333    0.3333         6
    B-ORG     0.8422    0.8879    0.8644       553
  B-TITLE     0.8811    0.8925    0.8867       772
   E-CONT     0.9655    1.0000    0.9825        28
    E-ORG     0.8262    0.8680    0.8466       553
   E-NAME     0.9000    0.8036    0.8491       112
  M-TITLE     0.9038    0.8751    0.8892      1922
    E-LOC     0.5000    0.5000    0.5000         6
    B-PRO     0.5581    0.7273    0.6316        33
    M-LOC     0.5833    0.3333    0.4242        21
        O     0.9568    0.9177    0.9369      5190
    M-PRO     0.4490    0.6471    0.5301        68
    M-EDU     0.9348    0.9609    0.9477       179
    E-PRO     0.6512    0.8485    0.7368        33
   E-RACE     1.0000    0.9286    0.9630        14
avg/total     0.9149    0.9122    0.9130     15100

Confusion Matrix:
          E-EDU  B-RACE E-TITLE  B-NAME  M-NAME  M-CONT   M-ORG  B-CONT   B-EDU   B-LOC   B-ORG B-TITLE  E-CONT   E-ORG  E-NAME M-TITLE   E-LOC   B-PRO   M-LOC       O   M-PRO   M-EDU   E-PRO  E-RACE
  E-EDU     110       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       1       0
 B-RACE       0      13       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       0
E-TITLE       1       0     744       0       0       0      15       0       0       0       4       0       0       0       0       2       0       0       0       6       0       0       0       0
 B-NAME       0       0       0      98       0       0       2       0       0       0       1       0       0       0       0       0       0       0       0       8       0       0       0       0
 M-NAME       0       0       0       0      70       0       3       0       0       0       0       0       0       0       6       0       0       0       0       3       0       0       0       0
 M-CONT       0       0       0       0       0      53       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  M-ORG       3       0       4       1       2       1    4034       0       3       0      38      17       1      42       2      53       3      10       5      70      25       1       7       0
 B-CONT       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-EDU       0       0       0       0       0       0       1       0     108       0       0       0       0       0       0       0       0       0       0       0       0       3       0       0
  B-LOC       0       0       0       0       0       0       0       0       0       2       3       0       0       0       0       0       0       0       0       1       0       0       0       0
  B-ORG       0       0       0       1       0       0      23       1       0       3     491       6       0       0       0       0       0       0       0      28       0       0       0       0
B-TITLE       0       0       1       0       0       0      23       0       2       0       6     689       0       1       0      28       0       2       0      20       0       0       0       0
 E-CONT       0       0       0       0       0       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0
  E-ORG       0       0       1       0       0       0      30       0       1       0       0       9       0     480       0      18       0       1       0      10       3       0       0       0
 E-NAME       0       0       0       0       2       0       0       0       0       0       0       0       0       3      90       0       0       0       0      16       0       0       0       0
M-TITLE       3       0       6       0       0       0     115       0       2       0       3      35       0      17       0    1682       0       1       0      44       7       4       3       0
  E-LOC       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       3       0       0       2       0       0       0       0
  B-PRO       0       0       0       0       0       0       5       0       1       0       0       0       0       0       0       0       0      24       0       0       3       0       0       0
  M-LOC       0       0       0       0       0       0       7       0       0       1       0       0       0       2       0       0       0       0       7       4       0       0       0       0
      O       2       0      26       0       0       0     204       0       1       0      37      26       0      30       2      78       0       3       0    4763      12       1       4       0
  M-PRO       0       0       0       0       0       0      18       0       1       0       0       0       0       3       0       0       0       1       0       0      44       1       0       0
  M-EDU       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       1       0       1       4     172       0       0
  E-PRO       1       0       0       0       0       0       0       0       1       0       0       0       0       2       0       0       0       0       0       0       0       1      28       0
 E-RACE       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0      13
加载并评估crf模型...
           precision    recall  f1-score   support
    E-EDU     0.9910    0.9821    0.9865       112
   B-RACE     1.0000    1.0000    1.0000        14
  E-TITLE     0.9857    0.9819    0.9838       772
   B-NAME     1.0000    0.9821    0.9910       112
   M-NAME     1.0000    0.9756    0.9877        82
   M-CONT     1.0000    1.0000    1.0000        53
    M-ORG     0.9523    0.9563    0.9543      4325
   B-CONT     1.0000    1.0000    1.0000        28
    B-EDU     0.9820    0.9732    0.9776       112
    B-LOC     1.0000    0.8333    0.9091         6
    B-ORG     0.9636    0.9566    0.9601       553
  B-TITLE     0.9376    0.9339    0.9358       772
   E-CONT     1.0000    1.0000    1.0000        28
    E-ORG     0.9199    0.9132    0.9165       553
   E-NAME     1.0000    0.9821    0.9910       112
  M-TITLE     0.9248    0.9022    0.9134      1922
    E-LOC     1.0000    0.8333    0.9091         6
    B-PRO     0.9091    0.9091    0.9091        33
    M-LOC     1.0000    0.8095    0.8947        21
        O     0.9630    0.9732    0.9681      5190
    M-PRO     0.8354    0.9706    0.8980        68
    M-EDU     0.9824    0.9330    0.9570       179
    E-PRO     0.9091    0.9091    0.9091        33
   E-RACE     1.0000    1.0000    1.0000        14
avg/total     0.9543    0.9543    0.9542     15100

Confusion Matrix:
          E-EDU  B-RACE E-TITLE  B-NAME  M-NAME  M-CONT   M-ORG  B-CONT   B-EDU   B-LOC   B-ORG B-TITLE  E-CONT   E-ORG  E-NAME M-TITLE   E-LOC   B-PRO   M-LOC       O   M-PRO   M-EDU   E-PRO  E-RACE
  E-EDU     110       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0
 B-RACE       0      14       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
E-TITLE       1       0     758       0       0       0       2       0       0       0       0       0       0       1       0       1       0       0       0       9       0       0       0       0
 B-NAME       0       0       0     110       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       2       0       0       0       0
 M-NAME       0       0       0       0      80       0       0       0       0       0       0       0       0       0       0       0       0       0       0       2       0       0       0       0
 M-CONT       0       0       0       0       0      53       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  M-ORG       0       0       2       0       0       0    4136       0       0       0       1      11       0      12       0      65       0       1       0      91       5       0       1       0
 B-CONT       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-EDU       0       0       0       0       0       0       1       0     109       0       1       0       0       0       0       0       0       0       0       0       0       1       0       0
  B-LOC       0       0       0       0       0       0       0       0       0       5       1       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-ORG       0       0       0       0       0       0       1       0       0       0     529      12       0       0       0       0       0       0       0      11       0       0       0       0
B-TITLE       0       0       0       0       0       0      12       0       0       0       7     721       0       0       0      22       0       1       0       9       0       0       0       0
 E-CONT       0       0       0       0       0       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0
  E-ORG       0       0       1       0       0       0      14       0       0       0       0       0       0     505       0      20       0       0       0      13       0       0       0       0
 E-NAME       0       0       0       0       0       0       0       0       0       0       0       0       0       0     110       0       0       0       0       2       0       0       0       0
M-TITLE       0       0       3       0       0       0      89       0       1       0       1      19       0      17       0    1734       0       0       0      54       2       1       1       0
  E-LOC       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       5       0       0       0       0       0       0       0
  B-PRO       0       0       0       0       0       0       1       0       1       0       0       0       0       0       0       0       0      30       0       0       1       0       0       0
  M-LOC       0       0       0       0       0       0       4       0       0       0       0       0       0       0       0       0       0       0      17       0       0       0       0       0
      O       0       0       5       0       0       0      75       0       0       0       9       6       0      11       0      33       0       0       0    5051       0       0       0       0
  M-PRO       0       0       0       0       0       0       2       0       0       0       0       0       0       0       0       0       0       0       0       0      66       0       0       0
  M-EDU       0       0       0       0       0       0       5       0       0       0       0       0       0       1       0       0       0       1       0       1       4     167       0       0
  E-PRO       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       0       0       0       1       1      30       0
 E-RACE       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0      14
加载并评估bilstm模型...
           precision    recall  f1-score   support
    E-EDU     0.9732    0.9732    0.9732       112
   B-RACE     1.0000    0.9286    0.9630        14
  E-TITLE     0.9754    0.9754    0.9754       772
   B-NAME     1.0000    0.8929    0.9434       112
   M-NAME     0.9186    0.9634    0.9405        82
   M-CONT     0.9815    1.0000    0.9907        53
    M-ORG     0.9631    0.9535    0.9583      4325
   B-CONT     1.0000    1.0000    1.0000        28
    B-EDU     0.9649    0.9821    0.9735       112
    B-LOC     1.0000    0.8333    0.9091         6
    B-ORG     0.9402    0.9675    0.9537       553
  B-TITLE     0.9457    0.9249    0.9352       772
   E-CONT     1.0000    1.0000    1.0000        28
    E-ORG     0.9194    0.9078    0.9136       553
   E-NAME     1.0000    0.9464    0.9725       112
  M-TITLE     0.9409    0.8871    0.9132      1922
    E-LOC     1.0000    1.0000    1.0000         6
    B-PRO     0.8182    0.8182    0.8182        33
    M-LOC     1.0000    1.0000    1.0000        21
        O     0.9541    0.9819    0.9678      5190
    M-PRO     0.7159    0.9265    0.8077        68
    M-EDU     0.9716    0.9553    0.9634       179
    E-PRO     0.8857    0.9394    0.9118        33
   E-RACE     1.0000    1.0000    1.0000        14
avg/total     0.9537    0.9532    0.9532     15100

Confusion Matrix:
          E-EDU  B-RACE E-TITLE  B-NAME  M-NAME  M-CONT   M-ORG  B-CONT   B-EDU   B-LOC   B-ORG B-TITLE  E-CONT   E-ORG  E-NAME M-TITLE   E-LOC   B-PRO   M-LOC       O   M-PRO   M-EDU   E-PRO  E-RACE
  E-EDU     109       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       1       1       0
 B-RACE       0      13       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       0
E-TITLE       1       0     753       0       0       0       0       0       0       0       0       0       0       2       0       2       0       0       0      14       0       0       0       0
 B-NAME       0       0       0     100       5       0       0       0       0       0       0       0       0       0       0       0       0       0       0       7       0       0       0       0
 M-NAME       0       0       0       0      79       0       0       0       0       0       0       0       0       0       0       0       0       0       0       3       0       0       0       0
 M-CONT       0       0       0       0       0      53       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  M-ORG       1       0       0       0       0       1    4124       0       0       0      21      11       0      16       0      46       0       2       0      94       8       0       1       0
 B-CONT       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-EDU       0       0       0       0       0       0       1       0     110       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0
  B-LOC       0       0       0       0       0       0       0       0       0       5       0       1       0       0       0       0       0       0       0       0       0       0       0       0
  B-ORG       0       0       0       0       0       0       3       0       1       0     535       4       0       0       0       0       0       0       0      10       0       0       0       0
B-TITLE       0       0       0       0       0       0      10       0       0       0       7     714       0       1       0      24       0       1       0      15       0       0       0       0
 E-CONT       0       0       0       0       0       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0
  E-ORG       0       0       1       0       0       0      14       0       0       0       0       1       0     502       0      21       0       0       0      11       3       0       0       0
 E-NAME       0       0       0       0       0       0       0       0       0       0       0       0       0       0     106       0       0       0       0       2       0       0       0       0
M-TITLE       1       0       6       0       2       0      81       0       1       0       0      17       0      16       0    1705       0       0       0      86       3       3       1       0
  E-LOC       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       6       0       0       0       0       0       0       0
  B-PRO       0       0       0       0       0       0       1       0       1       0       1       0       0       0       0       0       0      27       0       0       3       0       0       0
  M-LOC       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0      21       0       0       0       0       0
      O       0       0      12       0       0       0      44       0       0       0       5       7       0       7       0      13       0       2       0    5096       4       0       0       0
  M-PRO       0       0       0       0       0       0       4       0       0       0       0       0       0       1       0       0       0       0       0       0      63       0       0       0
  M-EDU       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       1       0       1       0       1       4     171       0       0
  E-PRO       0       0       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       0       0       0       1      31       0
 E-RACE       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0      14
加载并评估bilstm+crf模型...
           precision    recall  f1-score   support
    E-EDU     0.9820    0.9732    0.9776       112
   B-RACE     1.0000    0.9286    0.9630        14
  E-TITLE     0.9921    0.9767    0.9843       772
   B-NAME     1.0000    0.9196    0.9581       112
   M-NAME     0.9753    0.9634    0.9693        82
   M-CONT     1.0000    0.9623    0.9808        53
    M-ORG     0.9525    0.9635    0.9579      4325
   B-CONT     1.0000    0.9643    0.9818        28
    B-EDU     0.9820    0.9732    0.9776       112
    B-LOC     1.0000    0.8333    0.9091         6
    B-ORG     0.9555    0.9711    0.9632       553
  B-TITLE     0.9420    0.9262    0.9340       772
   E-CONT     1.0000    0.9643    0.9818        28
    E-ORG     0.9234    0.9150    0.9192       553
   E-NAME     1.0000    0.9375    0.9677       112
  M-TITLE     0.9528    0.8918    0.9213      1922
    E-LOC     1.0000    0.8333    0.9091         6
    B-PRO     0.9412    0.9697    0.9552        33
    M-LOC     1.0000    0.8095    0.8947        21
        O     0.9605    0.9827    0.9714      5190
    M-PRO     0.8684    0.9706    0.9167        68
    M-EDU     0.9767    0.9385    0.9573       179
    E-PRO     0.9118    0.9394    0.9254        33
   E-RACE     1.0000    1.0000    1.0000        14
avg/total     0.9574    0.9572    0.9570     15100

Confusion Matrix:
          E-EDU  B-RACE E-TITLE  B-NAME  M-NAME  M-CONT   M-ORG  B-CONT   B-EDU   B-LOC   B-ORG B-TITLE  E-CONT   E-ORG  E-NAME M-TITLE   E-LOC   B-PRO   M-LOC       O   M-PRO   M-EDU   E-PRO  E-RACE
  E-EDU     109       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       1       1       0
 B-RACE       0      13       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       0
E-TITLE       1       0     754       0       0       0       3       0       0       0       0       0       0       2       0       1       0       0       0      11       0       0       0       0
 B-NAME       0       0       0     103       2       0       0       0       0       0       0       0       0       0       0       0       0       0       0       7       0       0       0       0
 M-NAME       0       0       0       0      79       0       0       0       0       0       0       0       0       0       0       0       0       0       0       3       0       0       0       0
 M-CONT       0       0       0       0       0      51       0       0       0       0       0       0       0       0       0       0       0       0       0       2       0       0       0       0
  M-ORG       0       0       0       0       0       0    4167       0       0       0       9      14       0      16       0      37       0       0       0      77       4       0       1       0
 B-CONT       0       0       0       0       0       0       0      27       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       0
  B-EDU       0       0       0       0       0       0       2       0     109       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0
  B-LOC       0       0       0       0       0       0       0       0       0       5       1       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-ORG       0       0       0       0       0       0       1       0       0       0     537       5       0       0       0       0       0       0       0      10       0       0       0       0
B-TITLE       0       0       0       0       0       0      14       0       0       0       7     715       0       2       0      20       0       1       0      13       0       0       0       0
 E-CONT       0       0       0       0       0       0       0       0       0       0       0       0      27       0       0       0       0       0       0       1       0       0       0       0
  E-ORG       0       0       0       0       0       0      20       0       0       0       0       0       0     506       0      17       0       1       0       9       0       0       0       0
 E-NAME       0       0       0       0       0       0       0       0       0       0       0       0       0       0     105       0       0       0       0       6       0       0       0       0
M-TITLE       0       0       2       0       0       0     102       0       1       0       2      18       0      13       0    1714       0       0       0      66       2       1       1       0
  E-LOC       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       5       0       0       0       0       0       0       0
  B-PRO       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       0      32       0       0       0       0       0       0
  M-LOC       0       0       0       0       0       0       4       0       0       0       0       0       0       0       0       0       0       0      17       0       0       0       0       0
      O       0       0       4       0       0       0      57       0       0       0       5       7       0       7       0      10       0       0       0    5100       0       0       0       0
  M-PRO       0       0       0       0       0       0       1       0       0       0       0       0       0       1       0       0       0       0       0       0      66       0       0       0
  M-EDU       1       0       0       0       0       0       2       0       0       0       1       0       0       1       0       0       0       0       0       2       4     168       0       0
  E-PRO       0       0       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       0       0       0       1      31       0
 E-RACE       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0      14
Ensemble 四个模型的结果如下：
           precision    recall  f1-score   support
    E-EDU     0.9910    0.9821    0.9865       112
   B-RACE     1.0000    0.9286    0.9630        14
  E-TITLE     0.9832    0.9832    0.9832       772
   B-NAME     1.0000    0.9286    0.9630       112
   M-NAME     0.9756    0.9756    0.9756        82
   M-CONT     1.0000    1.0000    1.0000        53
    M-ORG     0.9434    0.9667    0.9549      4325
   B-CONT     1.0000    1.0000    1.0000        28
    B-EDU     0.9735    0.9821    0.9778       112
    B-LOC     1.0000    0.8333    0.9091         6
    B-ORG     0.9747    0.9747    0.9747       553
  B-TITLE     0.9426    0.9365    0.9396       772
   E-CONT     1.0000    1.0000    1.0000        28
    E-ORG     0.9305    0.9204    0.9255       553
   E-NAME     1.0000    0.9464    0.9725       112
  M-TITLE     0.9499    0.8975    0.9230      1922
    E-LOC     1.0000    0.8333    0.9091         6
    B-PRO     0.9000    0.8182    0.8571        33
    M-LOC     1.0000    0.8095    0.8947        21
        O     0.9679    0.9707    0.9693      5190
    M-PRO     0.7586    0.9706    0.8516        68
    M-EDU     0.9773    0.9609    0.9690       179
    E-PRO     0.8857    0.9394    0.9118        33
   E-RACE     1.0000    1.0000    1.0000        14
avg/total     0.9569    0.9565    0.9564     15100

Confusion Matrix:
          E-EDU  B-RACE E-TITLE  B-NAME  M-NAME  M-CONT   M-ORG  B-CONT   B-EDU   B-LOC   B-ORG B-TITLE  E-CONT   E-ORG  E-NAME M-TITLE   E-LOC   B-PRO   M-LOC       O   M-PRO   M-EDU   E-PRO  E-RACE
  E-EDU     110       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       1       0
 B-RACE       0      13       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       0
E-TITLE       1       0     759       0       0       0       2       0       0       0       0       0       0       1       0       1       0       0       0       8       0       0       0       0
 B-NAME       0       0       0     104       2       0       0       0       0       0       0       0       0       0       0       0       0       0       0       6       0       0       0       0
 M-NAME       0       0       0       0      80       0       0       0       0       0       0       0       0       0       0       0       0       0       0       2       0       0       0       0
 M-CONT       0       0       0       0       0      53       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  M-ORG       0       0       1       0       0       0    4181       0       0       0       4      10       0      14       0      38       0       0       0      68       8       0       1       0
 B-CONT       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-EDU       0       0       0       0       0       0       1       0     110       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0
  B-LOC       0       0       0       0       0       0       0       0       0       5       1       0       0       0       0       0       0       0       0       0       0       0       0       0
  B-ORG       0       0       0       0       0       0       0       0       0       0     539       5       0       0       0       0       0       0       0       9       0       0       0       0
B-TITLE       0       0       0       0       0       0      13       0       0       0       6     723       0       0       0      19       0       1       0      10       0       0       0       0
 E-CONT       0       0       0       0       0       0       0       0       0       0       0       0      28       0       0       0       0       0       0       0       0       0       0       0
  E-ORG       0       0       1       0       0       0      15       0       0       0       0       1       0     509       0      15       0       1       0       9       2       0       0       0
 E-NAME       0       0       0       0       0       0       0       0       0       0       0       0       0       0     106       0       0       0       0       5       0       0       0       0
M-TITLE       0       0       3       0       0       0     106       0       1       0       0      21       0      13       0    1725       0       0       0      48       3       1       1       0
  E-LOC       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       5       0       0       0       0       0       0       0
  B-PRO       0       0       0       0       0       0       2       0       1       0       0       0       0       0       0       0       0      27       0       0       3       0       0       0
  M-LOC       0       0       0       0       0       0       4       0       0       0       0       0       0       0       0       0       0       0      17       0       0       0       0       0
      O       0       0       8       0       0       0     106       0       0       0       3       7       0       8       0      18       0       0       0    5038       1       0       1       0
  M-PRO       0       0       0       0       0       0       1       0       0       0       0       0       0       1       0       0       0       0       0       0      66       0       0       0
  M-EDU       0       0       0       0       0       0       0       0       0       0       0       0       0       1       0       0       0       1       0       1       4     172       0       0
  E-PRO       0       0       0       0       0       0       0       0       1       0       0       0       0       0       0       0       0       0       0       0       0       1      31       0
 E-RACE       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0       0      14