SparseTensor(indices, values, dense_shape)
稀疏矢量的表示 indices shape为[N, ndims]的2-D int64矢量，用以指定非零元素的位置，比如indices=[[1,3], [2,4]]表示[1,3]和[2,4]位置的元素为非零元素。values shape为[N]的1-D矢量，对应indices所指位置的元素值dense_shape shape为[ndims]的1-D矢量，代表稀疏矩阵的shape SparseTensor(indices=[[0, 0], [1, 2]], values=[1, 2], dense_shape=[3, 4])>>[[1, 0, 0, 0][0, 0, 2, 0][0, 0, 0, 0]]SparseTensor(indices=[[0], [3]], values=[4, 6], dense_shape=[7])>>[4, 0, 0, 6, 0, 0, 0]稀疏矢量的封装并不直观，可以通过稀疏矢量的方式构建矢量（sparse_to_dense）或者将稀疏矢量转换成矢sparse_tensor_to_dense量的方式来感受一下:
def sparse_to_dense(sparse_indices,output_shape,sparse_values,default_value=0,validate_indices=True,name=None) sparse_indices sparse_indices：稀疏矩阵中那些个别元素对应的索引值。 sparse_indices是个数，那么它只能指定一维矩阵的某一个元素sparse_indices是个向量，那么它可以指定一维矩阵的多个元素sparse_indices是个矩阵，那么它可以指定二维矩阵的多个元素output_shape 输出的稀疏矩阵的shapesparse_value 个别元素的值 sparse_values是个数：所有索引指定的位置都用这个数sparse_values是个向量：输出矩阵的某一行向量里某一行对应的数（所以这里向量的长度应该和输出矩阵的行数对应，不然报错）default_value：未指定元素的默认值，一般如果是稀疏矩阵的话就是0了实例展示
import tensorflow as tf import numpy BATCHSIZE=6label=tf.expand_dims(tf.constant([0,2,3,6,7,9]),1)index=tf.expand_dims(tf.range(0, BATCHSIZE),1)# use a matrixconcated = tf.concat([index, label], 1) # [[0, 0], [0, 2], [0, 3], [0, 6], [0, 7], [0, 9]] (6,2)onehot_labels = tf.sparse_to_dense(concated, [BATCHSIZE,10], 1.0, 0.0)# use a vectorsparse_indices2=tf.constant([1,3,4])onehot_labels2 = tf.sparse_to_dense(sparse_indices2, [10], 1.0, 0.0)#can use# use a scalarsparse_indices3=tf.constant(5)onehot_labels3 = tf.sparse_to_dense(sparse_indices3, [10], 1.0, 0.0)sparse_tensor_00 = tf.SparseTensor(indices=[[0,0,0], [1,1,2]], values=[4, 6], dense_shape=[2,2,3])dense_tensor_00 = tf.sparse_tensor_to_dense(sparse_tensor_00)with tf.Session(config=config) as sess:result1=sess.run(onehot_labels)result2 = sess.run(onehot_labels2)result3 = sess.run(onehot_labels3)result4 = sess.run(dense_tensor_00)print ("This is result1:")print (result1)print ("This is result2:")print (result2)print ("This is result3:")print (result3)print ("This is result4:")print (result4)输出结果如下
[[1. 0. 0. 0. 0. 0. 0. 0. 0. 0.][0. 0. 1. 0. 0. 0. 0. 0. 0. 0.][0. 0. 0. 1. 0. 0. 0. 0. 0. 0.][0. 0. 0. 0. 0. 0. 1. 0. 0. 0.][0. 0. 0. 0. 0. 0. 0. 1. 0. 0.][0. 0. 0. 0. 0. 0. 0. 0. 0. 1.]]This is result2:[0. 1. 0. 1. 1. 0. 0. 0. 0. 0.]This is result3:[0. 0. 0. 0. 0. 1. 0. 0. 0. 0.]This is result4:[[[4 0 0][0 0 0]][[0 0 0][0 0 6]]] 区别两者的区别可以通过应用来说起
If you would like to define the tensor outside the graph, e.g. define the sparse tensor for later data feed, use SparseTensorValue. In contrast, if the sparse tensor is defined in graph, use SparseTensor
在graph定义sparse_placeholder，在feed中需要使用SparseTensorValue
x_sp = tf.sparse_placeholder(dtype=tf.float32)W = tf.Variable(tf.random_normal([6, 6]))y = tf.sparse_tensor_dense_matmul(sp_a=x_sp, b=W)init = tf.global_variables_initializer()gpu_options = tf.GPUOptions(per_process_gpu_memory_fraction=0.2)sess = tf.Session(config=tf.ConfigProto(gpu_options=gpu_options))sess.run(init)stv = tf.SparseTensorValue(indices=[[0, 0], [1, 2]], values=[1.1, 1.2], dense_shape=[2,6])result = sess.run(y,feed_dict={x_sp:stv})print(result)在graph中做定义需要使用SparseTensor
indices_i = tf.placeholder(dtype=tf.int64, shape=[2, 2])values_i = tf.placeholder(dtype=tf.float32, shape=[2])dense_shape_i = tf.placeholder(dtype=tf.int64, shape=[2])st = tf.SparseTensor(indices=indices_i, values=values_i, dense_shape=dense_shape_i)W = tf.Variable(tf.random_normal([6, 6]))y = tf.sparse_tensor_dense_matmul(sp_a=st, b=W)init = tf.global_variables_initializer()gpu_options = tf.GPUOptions(per_process_gpu_memory_fraction=0.2)sess = tf.Session(config=tf.ConfigProto(gpu_options=gpu_options))sess.run(init)result = sess.run(y,feed_dict={indices_i:[[0, 0], [1, 2]], values_i:[1.1, 1.2], dense_shape_i:[2,6]})print(result)在feed中应用SparseTensor，需要使用运算
x = tf.sparse_placeholder(tf.float32)y = tf.sparse_reduce_sum(x)config = tf.ConfigProto()config.gpu_options.allow_growth = Trueconfig.allow_soft_placement = Truewith tf.Session(config=config) as sess:indices = np.array([[3, 2, 0], [4, 5, 1]], dtype=np.int64)values = np.array([1.0, 2.0], dtype=np.float32)shape = np.array([7, 9, 2], dtype=np.int64)print(sess.run(y, feed_dict={x: tf.SparseTensorValue(indices, values, shape)})) # Will succeed.print(sess.run(y, feed_dict={x: (indices, values, shape)})) # Will succeed.sp = tf.SparseTensor(indices=indices, values=values, dense_shape=shape)sp_value = sp.eval(session=sess)print(sp_value)print(sess.run(y, feed_dict={x: sp_value})) # Will succeed.
