Pandas pivot to sparse

from scipy.sparse import csr_matrix
from pandas.api.types import CategoricalDtype

person_c = CategoricalDtype(sorted(frame.person.unique()), ordered=True)
thing_c = CategoricalDtype(sorted(frame.thing.unique()), ordered=True)

row = frame.person.astype(person_c).cat.codes
col = frame.thing.astype(thing_c).cat.codes
sparse_matrix = csr_matrix((frame["count"], (row, col)), \
                           shape=(person_c.categories.size, thing_c.categories.size))

>>> sparse_matrix
<3x4 sparse matrix of type '<class 'numpy.int64'>'
     with 6 stored elements in Compressed Sparse Row format>

>>> sparse_matrix.todense()
matrix([[0, 1, 0, 1],
        [1, 0, 0, 1],
        [1, 0, 1, 0]], dtype=int64)


dfs = pd.SparseDataFrame(sparse_matrix, \
                         index=person_c.categories, \
                         columns=thing_c.categories, \
                         default_fill_value=0)
>>> dfs
        a   b   c   d
 him    0   1   0   1
  me    1   0   0   1
 you    1   0   1   0

Source: stackoverflow.com

Similar codes

2 votes186 views2 answers
Label encoding
Python
10 votes207 views3 answers
Logarithmic regression python
Python
0 vote210 views1 answer
Python urlopen parameters
Python
0 vote214 views1 answer
Django multi column index
Python
0 vote194 views1 answer
Find the first occurrence of item in a list in python
Python
-1 vote220 views1 answer
Dataframe partition dataset based on column
Python
0 vote201 views1 answer
Set_flip_h( false )
Python
0 vote204 views1 answer
Django queryset group by sum
Python
11 votes198 views3 answers
Practicing python
Python
0 vote213 views1 answer
Python loop over s3 objects]
Python