Difference between revisions of "TODO"

From Minetest Developer Wiki
Jump to navigation Jump to search
(→‎TODO in Luanti: Add the rename to TODO list)
 
(70 intermediate revisions by 21 users not shown)
Line 1: Line 1:
== Things to do right away ==
+
{{Mbox|type=issue|text='''Checkout the [https://github.com/minetest/minetest/blob/master/doc/direction.md roadmap] instead'''<br/>The roadmap outlines a consensus on medium-term Luanti development. This page contains other wishlist items from core developers, but hasn't necessarily reached a consensus and may be long term.}}
* Add option to use node names in LuaVoxelManip data    - not needed; just use place_schematic, it's good enough
+
 
* Add API to get biome information from ID              - should be done in Lua: add a wrapper for register_biome() and add biome definitions to a table, use that to index information without an API
+
== TODO in Luanti ==
* Merge Lua main menu
+
=== Things to do soon ===
 +
 
 +
* [https://github.com/minetest/minetest/issues/15322 Complete the rename from Minetest to Luanti]
 +
 
 +
==== Mapgen ====
  
== Things to do soon ==
 
=== Mapgen ===
 
 
* Add configuration for DungeonGen
 
* Add configuration for DungeonGen
 
* Add configuration for CaveGen
 
* Add configuration for CaveGen
* Make permanent solution for caves spawning inside of trees - Can do this by checking if is_ground_content, now.
 
  
=== Mapgen V7 ===
+
==== DecorationDef ====
* Fix noncontinuous terrain problem
 
* Add positive 3d noise for better mountains; reduce negative 3d noise effects and 2d noise scale
 
* Fix small caves routing through smooth terrain; especially with water
 
* Fix large caves mixing lava and water too much
 
  
=== DecorationDef ===
 
* Add Lua callbacks for decoration placement if requested
 
* Add L-system decoration support
 
 
* Add cutoff handling
 
* Add cutoff handling
* Give decorations some sort of unique ID so they can be referenced in biome definitions
 
* Allow decorations to have unresolved biomes so they can be registered afterward
 
  
=== BiomeDefManager ===
+
==== BiomeDefManager ====
 +
 
 
* Add biomemap cache
 
* Add biomemap cache
 
* Scale temperature and humidity noise to more sensible value ranges
 
* Scale temperature and humidity noise to more sensible value ranges
 
* Add biome weight attribute
 
* Add biome weight attribute
* Optimize K-means system for biome matching, and use instead of linear search?
+
* Find out how to account for elevation better!
* Add Voronoi diagram maker?
+
* Add Voronoi diagram maker? https://forum.minetest.net/viewtopic.php?f=9&t=13163
 +
 
 +
==== MapVoxelManipulator ====
  
=== MapVoxelManipulator ===
 
 
* Figure out a permanent, elegant solution to the walled-in cave problem - can use is_ground_content now - does this belong in VoxelManipulator?
 
* Figure out a permanent, elegant solution to the walled-in cave problem - can use is_ground_content now - does this belong in VoxelManipulator?
  
=== EmergeThread ===
+
==== EmergeThread ====
 +
 
 
* Figure out the thread priority mess
 
* Figure out the thread priority mess
 
* Assign thread affinities for a bit of a performance boost (reduce L2 cache misses)
 
* Assign thread affinities for a bit of a performance boost (reduce L2 cache misses)
  
=== Other ===
+
==== GUIs / Formspecs ====
 +
 
 +
* New main menu, which promotes Luanti better [https://github.com/minetest/minetest/issues/6733 6733]
 +
* Refactor formspec / GUI code to be independent from serialisation [https://github.com/minetest/minetest/issues/9358 9358]
 +
* Add new GUI API, probably based on a Lua DSL [https://github.com/minetest/minetest/issues/6527 6527]
 +
* New GUI default theme [https://github.com/minetest/minetest/issues/9802 9802]
 +
 
 +
==== Other ====
 +
 
 +
* Make a library for reading a Luanti map without worrying about the database used. (libmtmap?)
 
* Add block tinting (grass, water, sky, etc.) (for biomes)
 
* Add block tinting (grass, water, sky, etc.) (for biomes)
* Merge leveldb pull request
 
 
* Add Fullbright option
 
* Add Fullbright option
* Re-do rollback to not be slow
 
  
 +
=== Big, long term goals (Client) ===
 +
 +
==== Client-Side Scripting (CSM) ====
 +
See original plans: [[Client_scripting_plans]]
 +
 +
* Server-Sent Client-Side Modding (SSCSM)
 +
* Client-side prediction APIs
 +
* GUI APIs
 +
 +
==== Client-Side Biomes ====
 +
The server should transfer biome definitions to the client which calculates biomes locally.
 +
Crossing over into a new biome should trigger a client-side script callback
 +
Biomes have effects:
 +
* Full scene post-effects (tint everything a different color)
 +
* Temporarily override settings (cloud_height, enable_clouds, water_wave_height, water_wave_length, water_wave_speed)
 +
 +
==== Hardware Lighting for Light Sources ====
 +
 +
''' Description '''<br />
 +
Benefits:
 +
 +
* would allow variable light range and cutoff
 +
* would free up param1 of MapNodes to be used for storing more immediate node metadata (always a good thing!).
 +
* would allow colored light sources
 +
 +
Of course, can use dynamic lights, except they're very intensive and generally a scarce resource
 +
Dynamically generated lightmaps seem like a good way forward. <br />
 +
http://joshbeam.com/articles/dynamic_lightmaps_in_opengl/
 
<br />
 
<br />
 +
RealBadAngel is currently working on shader-based lighting. ''What strategy is he using?''
 +
<br />
 +
 +
==== Occlusion Culling/Occlusion Query ====
 +
 +
Irrlicht does support occlusion culling.  If enabled, it culls scene nodes which are entirely out of the camera's view fulcrum. <br />
 +
Problem:  The entire map is an Irrlicht scene node. ''Why? What was the rationale for this decision?''<br />
 +
Solution:  Make scene nodes per MapBlock. <br />
 +
While we're at it, playing around with scene nodes, it'd probably be a good idea to maintain two (or three) separate nodes for each MapBlock, one for each type of material.  Opaque, transparent, and liquid drawtypes.  This fixes the still unsolved material transparency problem.
 +
 +
=== Big, long term goals (Server) ===
 +
 +
==== Voxel Area Entities ====
  
== Big, long term goals ==
 
=== Voxel Area Entities ===
 
 
''' Description '''<br />
 
''' Description '''<br />
How cool would it be to build a full-sized boat in Minetest, and then drive it around the ocean? That's one example of something that would be possible with this feature.<br />
+
How cool would it be to build a full-sized boat in Luanti, and then drive it around the ocean? That's one example of something that would be possible with this feature.<br />
 
Voxel Area Entities are moveable ActiveObjects whose mesh and texture is user-modifiable via setting MapNodes in it. This is an extremely powerful feature, and while perhaps not of extreme difficulty to implement, there is very much to be done.<br />
 
Voxel Area Entities are moveable ActiveObjects whose mesh and texture is user-modifiable via setting MapNodes in it. This is an extremely powerful feature, and while perhaps not of extreme difficulty to implement, there is very much to be done.<br />
 
''' What needs to be done '''
 
''' What needs to be done '''
Line 56: Line 97:
 
* Some way to store these in the map. Perhaps these objects will get special non-block-ID keys in the map DB.
 
* Some way to store these in the map. Perhaps these objects will get special non-block-ID keys in the map DB.
 
* A decent way to serialize these objects. This detail in particular will require special attention.
 
* A decent way to serialize these objects. This detail in particular will require special attention.
 +
* For the previous two points, see http://irc.minetest.net/minetest-dev/2013-10-21#i_3383926 for a discussion of a possible way to handle the objects.
 
<br />
 
<br />
  
=== Envlock Scope Reduction ===
+
==== Envlock Scope Reduction ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
Envlock needs to be put on a diet. Seriously. This is believed to be the primary reason for perceived unresponsiveness in Minetest - solving this would help matters immensely.<br />
+
Envlock needs to be put on a diet. Seriously. This is believed to be the primary reason for perceived unresponsiveness in Luanti - solving this would help matters immensely.<br />
 
''' What needs to be done '''
 
''' What needs to be done '''
 
* Add a thin abstraction layer for atomic operation intrinsics.
 
* Add a thin abstraction layer for atomic operation intrinsics.
Line 68: Line 111:
 
<br />
 
<br />
  
=== Mapgen V5 ===
+
==== Pre-generate world ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
Revival of the 3d perlin noise-based generator that produced excellent looking terrain. Used to be very slow, which is the reason why it was ultimately dumped for V6 - this is no longer a problem with the new perlin noise map functions, which are insanely fast. celeron55 specifically requested to be the one to do this.<br />
 
 
''' What needs to be done '''
 
''' What needs to be done '''
* Class-ify the V5 mapgen code. Create noise objects and handle parameters in the constructor, destroy noise objects in the destructor.
 
* Replace all NoiseBuffer calls with array accesses to the 3d noise result array
 
* Replace lighting and liquid updates with calls to the parent Mapgen class' updateLiquid() and updateLighting(). Replace cave, dungeon, and tree generation with the appropriate generalized calls too.
 
* Overall code cleanup would be nice in addition.
 
 
<br />
 
<br />
  
=== Pre-generate world ===
+
==== Add colorlike to node param types ====
''' Description '''<br />
 
''' What needs to be done '''
 
<br />
 
  
=== Store block differences only ===
 
 
''' Description '''<br />
 
''' Description '''<br />
Instead of storing everything in the database, only store the changed mapblocks (or even only modified nodes?).  This would save a lot of space.<br />
+
Add a field like facedir, wallmounted, and liquidlike called colorlike that will allow the user to register a set of colors so that the color of some base node is modified on draw.  This would save many node definitions.<br />
''' What needs to be done '''
+
This field would be (part of, at least) param2 in a MapNode.  If colorlike is specified on its own, then it can define and use up to 256 colors. If used with facedir or wallmounted, then, it can only define and use 8 colors.
* Change the mapblock saving code to only save modified blocks.
 
* Change the mapblock loading code to mapgen, and then load changed blocks.
 
 
<br />
 
<br />
=== Rivers ===
 
''' Description '''<br />
 
Add rivers to map generator.<br />
 
Did some work on rivers alongside Mapgen V7.  Unexpectedly, applying logarithm to terrain height seems to work rather well for this.  For 1 < x < 0, log(x) returns a steeply decreasing negative number, below the typical water_level.  The rather short interval in which this result occurs draws an outline between higher regions of noise.  Unfortunately, the overall level of quality of rivers created with this method is low.  Rivers tend to be in a closed loop, vary too greatly in width, and don't branch off to other streams.<br />
 
<gallery>
 
File:logrivers.png|Rivers generated using the logarithm method.
 
File:riverattempt.jpg|An attempt at superimposing rivers onto normally-generated terrain
 
File:riverattempt2.jpg|Another screenshot from a different position of the same map
 
</gallery>
 
 
''' What needs to be done '''<br />
 
''' What needs to be done '''<br />
* Find an algorithm to produce nice rivers (Lightning fractal algorithm is a decent candidate)
+
* Store a color LUT with the ContentFeatures for the defined node that is to be passed along from Lua when registering the node.
* Find a way to make them completely connected from block-to-block (difficult)
+
* Figure out how to draw these colors in inventory screens and what not without having to prerender more textures
 +
* Bump ContentFeatures version
 
<br />
 
<br />
  
=== Add colorlike to node param types ===
+
==== Rewrite falling code to C++ ====
 +
 
 
''' Description '''<br />
 
''' Description '''<br />
Add a field like facedir, wallmounted, and liquidlike called colorlike that will allow the user to register a set of colors so that the color of some base node is modified on draw. This would save many textures and node definitions.<br />
+
nodeupdate() now very slow and can't handle large amount of falling nodes.
This field would be (part of, at least) param2 in a MapNode. If colorlike is specified on its own, then it can define and use up to 256 colors.  If used with facedir or wallmounted, then, it can only define and use 8 colors.
+
100-1000 falling nodes now makes server very slow, 10000+ cause segfault.
 +
To test - make sand floating island via mapgen, touch it
 
<br />
 
<br />
 
''' What needs to be done '''<br />
 
''' What needs to be done '''<br />
* Store a color LUT with the ContentFeatures for the defined node that is to be passed along from Lua when registering the node.
+
Rewrite in core with queue (like Map::transformLiquids)
* Figure out how to draw these colors in inventory screens and what not without having to prerender more textures
 
* Bump ContentFeatures version
 
 
<br />
 
<br />
  
== TODO in minetest_game ==
+
==== Pathfinder ====
===== To do immediately =====
+
See [[Pathfinder wishlist]].
* Make gold not look like American cheese
 
* Use a new texture for bronze blocks (and for other ore blocks too)
 
===== Gameplay mechanics =====
 
* Beds? Need to think about this one more. [http://forum.minetest.net/viewtopic.php?id=2625 Beds Mod]
 
* Enderballs (or at least the teleportation aspect of it in something else). ''[http://forum.minetest.net/viewtopic.php?id=2805 Throwing mod by PilzAdam] has teleport arrows; use mese crystal fragments for teleportation?''
 
===== Add things to surface =====
 
(so we do have something else than mining)
 
* More trees. ''Not as a mod, nodes will be added on request if they are added to mapgen'' [http://forum.minetest.net/viewtopic.php?id=4394 More Trees Mod]
 
===== Sounds =====
 
* Add more variants of each sound (4 sounds good)
 
* Add hurt sounds (already supported by the engine)
 
  
== Other ==
+
=== Big protocol changes ===
* Remove support for optdepends.txt at the end of 2013 https://github.com/minetest/minetest/commit/969d2b3eb1f30e257823d9220697e47735be68e3
+
 
* Remove support for common mods after 0.4.7 or so https://github.com/minetest/minetest/commit/306d1ab866a3ce820e95f4faf805684cd4122ae4
+
There are several features that would probably bring benefits in the long term, but can't currently be merged because of network protocol incompatibility.
 +
That is, they either can't be implemented in a way that lets old clients connect to new servers and new clients to old servers, or it would be a major pain to do so.
 +
The point of this section is to list such features so that they can be merged at once: a one-time incompatibility, perhaps coinciding with the release of 0.5.0,
 +
is better than breaking compatibility all the time.
 +
'''Note: ''' Not all of the things listed below need to be done, these are just ideas.
 +
* A binary key-value storage which easily supports missing fields with default values (e.g. [https://github.com/celeron55/minetest/blob/meta_set_nodedef_2/src/util/template_serialize.h header], [https://github.com/celeron55/minetest/blob/meta_set_nodedef_2/src/util/template_serialize.cpp source], [https://github.com/celeron55/minetest/blob/meta_set_nodedef_2/src/nodedef.cpp#L327 usage])
 +
* Using TCP for reliable data transfer (e.g. [https://github.com/celeron55/minetest/tree/tcp_connection tcp_connection])
 +
* Make the client request mapblocks (e.g. [https://github.com/celeron55/minetest/tree/tcp_blocks_2 tcp_blocks_2])
 +
* Improved authentication and encryption
 +
* Remove old compatibility kludges.
 +
* Many command IDs have become obsolete in the protocol: they could be consolidated
 +
* Change builtin CONTENT_* to 0, 1, 2
 +
<br />
  
 
== See also ==
 
== See also ==
 +
* [https://wiki.minetest.net/Terminology Terminology]
  
* [[Terminology]]
+
[[Category:Core Engine]]
 +
[[Category:Proposal‏‎]]

Latest revision as of 13:11, 24 October 2024

Mbox important.png Checkout the roadmap instead
The roadmap outlines a consensus on medium-term Luanti development. This page contains other wishlist items from core developers, but hasn't necessarily reached a consensus and may be long term.

TODO in Luanti

Things to do soon

Mapgen

  • Add configuration for DungeonGen
  • Add configuration for CaveGen

DecorationDef

  • Add cutoff handling

BiomeDefManager

MapVoxelManipulator

  • Figure out a permanent, elegant solution to the walled-in cave problem - can use is_ground_content now - does this belong in VoxelManipulator?

EmergeThread

  • Figure out the thread priority mess
  • Assign thread affinities for a bit of a performance boost (reduce L2 cache misses)

GUIs / Formspecs

  • New main menu, which promotes Luanti better 6733
  • Refactor formspec / GUI code to be independent from serialisation 9358
  • Add new GUI API, probably based on a Lua DSL 6527
  • New GUI default theme 9802

Other

  • Make a library for reading a Luanti map without worrying about the database used. (libmtmap?)
  • Add block tinting (grass, water, sky, etc.) (for biomes)
  • Add Fullbright option

Big, long term goals (Client)

Client-Side Scripting (CSM)

See original plans: Client_scripting_plans

  • Server-Sent Client-Side Modding (SSCSM)
  • Client-side prediction APIs
  • GUI APIs

Client-Side Biomes

The server should transfer biome definitions to the client which calculates biomes locally. Crossing over into a new biome should trigger a client-side script callback Biomes have effects:

* Full scene post-effects (tint everything a different color)
* Temporarily override settings (cloud_height, enable_clouds, water_wave_height, water_wave_length, water_wave_speed)

Hardware Lighting for Light Sources

Description
Benefits:

  • would allow variable light range and cutoff
  • would free up param1 of MapNodes to be used for storing more immediate node metadata (always a good thing!).
  • would allow colored light sources

Of course, can use dynamic lights, except they're very intensive and generally a scarce resource Dynamically generated lightmaps seem like a good way forward.
http://joshbeam.com/articles/dynamic_lightmaps_in_opengl/
RealBadAngel is currently working on shader-based lighting. What strategy is he using?

Occlusion Culling/Occlusion Query

Irrlicht does support occlusion culling. If enabled, it culls scene nodes which are entirely out of the camera's view fulcrum.
Problem: The entire map is an Irrlicht scene node. Why? What was the rationale for this decision?
Solution: Make scene nodes per MapBlock.
While we're at it, playing around with scene nodes, it'd probably be a good idea to maintain two (or three) separate nodes for each MapBlock, one for each type of material. Opaque, transparent, and liquid drawtypes. This fixes the still unsolved material transparency problem.

Big, long term goals (Server)

Voxel Area Entities

Description
How cool would it be to build a full-sized boat in Luanti, and then drive it around the ocean? That's one example of something that would be possible with this feature.
Voxel Area Entities are moveable ActiveObjects whose mesh and texture is user-modifiable via setting MapNodes in it. This is an extremely powerful feature, and while perhaps not of extreme difficulty to implement, there is very much to be done.
What needs to be done

  • A new derived SAO and CAO (they would need to be treated fundamentally differently), along with setNode() and removeNode() calls.
  • A derived VoxelManipulator class, perhaps called ObjectVoxelManipulator, which will be used to manipulate them.
  • These types of objects have meshes, and will need to be updated in MeshUpdateThread along with MapBlocks.
  • Some way to store these in the map. Perhaps these objects will get special non-block-ID keys in the map DB.
  • A decent way to serialize these objects. This detail in particular will require special attention.
  • For the previous two points, see http://irc.minetest.net/minetest-dev/2013-10-21#i_3383926 for a discussion of a possible way to handle the objects.


Envlock Scope Reduction

Description
Envlock needs to be put on a diet. Seriously. This is believed to be the primary reason for perceived unresponsiveness in Luanti - solving this would help matters immensely.
What needs to be done

  • Add a thin abstraction layer for atomic operation intrinsics.
  • Replace Environment operations that require concurrency but are simple enough with the said atomic operations and clever ordering.
  • Add a thread-safe hashtable structure to be used instead of std::map (or core::map) where locks would be needed, make use of this.
  • RCU for Map things - big structures such as MapBlocks could benefit from Read-Copy-Update for synchronization. This is the biggest change, but the reward would be immense.


Pre-generate world

Description
What needs to be done

Add colorlike to node param types

Description
Add a field like facedir, wallmounted, and liquidlike called colorlike that will allow the user to register a set of colors so that the color of some base node is modified on draw. This would save many node definitions.
This field would be (part of, at least) param2 in a MapNode. If colorlike is specified on its own, then it can define and use up to 256 colors. If used with facedir or wallmounted, then, it can only define and use 8 colors.
What needs to be done

  • Store a color LUT with the ContentFeatures for the defined node that is to be passed along from Lua when registering the node.
  • Figure out how to draw these colors in inventory screens and what not without having to prerender more textures
  • Bump ContentFeatures version


Rewrite falling code to C++

Description
nodeupdate() now very slow and can't handle large amount of falling nodes. 100-1000 falling nodes now makes server very slow, 10000+ cause segfault. To test - make sand floating island via mapgen, touch it
What needs to be done
Rewrite in core with queue (like Map::transformLiquids)

Pathfinder

See Pathfinder wishlist.

Big protocol changes

There are several features that would probably bring benefits in the long term, but can't currently be merged because of network protocol incompatibility. That is, they either can't be implemented in a way that lets old clients connect to new servers and new clients to old servers, or it would be a major pain to do so. The point of this section is to list such features so that they can be merged at once: a one-time incompatibility, perhaps coinciding with the release of 0.5.0, is better than breaking compatibility all the time. Note: Not all of the things listed below need to be done, these are just ideas.

  • A binary key-value storage which easily supports missing fields with default values (e.g. header, source, usage)
  • Using TCP for reliable data transfer (e.g. tcp_connection)
  • Make the client request mapblocks (e.g. tcp_blocks_2)
  • Improved authentication and encryption
  • Remove old compatibility kludges.
  • Many command IDs have become obsolete in the protocol: they could be consolidated
  • Change builtin CONTENT_* to 0, 1, 2


See also