Pandas pivot to sparse

from scipy.sparse import csr_matrix
from pandas.api.types import CategoricalDtype

person_c = CategoricalDtype(sorted(frame.person.unique()), ordered=True)
thing_c = CategoricalDtype(sorted(frame.thing.unique()), ordered=True)

row = frame.person.astype(person_c).cat.codes
col = frame.thing.astype(thing_c).cat.codes
sparse_matrix = csr_matrix((frame["count"], (row, col)), \
                           shape=(person_c.categories.size, thing_c.categories.size))

>>> sparse_matrix
<3x4 sparse matrix of type '<class 'numpy.int64'>'
     with 6 stored elements in Compressed Sparse Row format>

>>> sparse_matrix.todense()
matrix([[0, 1, 0, 1],
        [1, 0, 0, 1],
        [1, 0, 1, 0]], dtype=int64)


dfs = pd.SparseDataFrame(sparse_matrix, \
                         index=person_c.categories, \
                         columns=thing_c.categories, \
                         default_fill_value=0)
>>> dfs
        a   b   c   d
 him    0   1   0   1
  me    1   0   0   1
 you    1   0   1   0

Source: stackoverflow.com

Similar codes

0 vote281 views1 answer
How to add multiple items in a list in python
Python
31 votes255 views6 answers
Regex to validate email
Python
5 votes260 views2 answers
Python yaml parser
Python
11 votes289 views1 answer
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe7 in position 5: invalid continuation byte
Python
0 vote278 views1 answer
Sendgrid django smtp
Python
5 votes265 views2 answers
Python if any element in string
Python
2 votes324 views2 answers
Pandas shift columns down until value
Python
0 vote289 views1 answer
Numpy roll
Python
10 votes264 views6 answers
Progress bar python
Python
0 vote255 views1 answer
Compare two data frames in assert
Python